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Brief Reports: 


A New Publication Procedure 


For a trial period, the Journal of Consult- 
ing Psychology will accept “brief reports” for 
early publication without expense to the au- 
thor, under certain conditions. The new pro- 
cedure is intended to reduce publication lag 
and permit the circulation of worth-while 
studies of specialized interest or minor im- 
portance which cannot be accepted at present 
because of limitations of space. 

A brief report, strictly limited to one printed 
page, may be accepted if the author agrees to 
make a more extended report available. Up to 
four pages in each issue may be devoted to 
brief reports, published in the order of their 
receipt without regard to the dates of receipt 
of articles accepted for regular publication. It 
is anticipated that most of the brief reports 
can appear in the first or second issue to go 
to press following their acceptance, 

The procedure for submitting a brief re- 
port is: n 

1. The author sends the editor both the 
brief report and a more complete report of the 
study. The full report should be of sufficient 
length to give a clear account of the back- 
ground, procedure, results, and conclusions of 
the study. 

2. The full report is prepared: in h 
specified by the Publication Manual 7 Doe 
cept that it may be typed with single spacing. 


The editor will send the full report 
ant Port to the 


» condensed 
Study, and 


Om 


The text of the brief report, including all 
matter except the title and the author’s lines, 
does not exceed 80 typewritten lines averaging 
42 characters and spaces in length. Set the 
typewriter margins for short lines of 42 char- 
acters, which are 3.5 inches long in elite typ- 


ing, or 4.2 inches long in pica. The manuscript — 


is double spaced throughout and, except for 
the short lines, follows the standard style (1). 
Headings, tables, and references are avoided 


in the brief report. If essential, they must be - 


counted in the 80 lines. The brief report in- 
cludes, within its 80 lines, a footnote in this 
style: + 


1An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. [giving the author’s full name 
and address] or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. ..... from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C., remitting 
in advance @......... for microfilm or .......... for photo- 
copies. Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress. 


4. The author of a brief report prepares at 
least 100 mimeographed copies of the extended 
report. He agrees: (a) to send copies of the 
extended report upon request as long as the 
supply lasts, and (b) not to submit the ex- 
tended report for Publication to another 
printed journal of general circulation. 
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An Objective Comparison of Rogerian and 
Psychoanalytic Techniques’ 


Hans H. Strupp’ 
Washington, D. C. 


The research effort by Carl Rogers and his - 


Students to describe and elucidate the process 
of nondirective counseling has provided ob- 
jective evidence in an area in which such 
evidence has been sorely lacking. Unfortu- 
nately, this impetus has not extended to other 
theories of psychotherapy, particularly those 
e based more explicitly’ upon psychoanalytic 
principles, which today claim a numerically 
much larger following. The result of this 
development is a reasonably well-documented 
body of knowledge concerning client-centered 
counseling but almost a total absence of em- 
Pical data on psychoanalytically oriented 
erapy (cf. Saslow’s recent review [7])- 
i It is not surprising that much of the pub- 
ished research has focused upon the results 
of treatment and upon the development of 
methodologies for the description of the inter- 
Personal process of therapy. It was also in- 
pale that the patient, for whose benefit 
tai treatment is conducted, would receive a 
È ir share of attention from investigators; it 1s 
i apparent why so little research effort has 
peen expended upon the psychotherapist. Yet, 
it is almost axiomatic that the therapist’s per- 


hee thle article is one in a series of investigations 
aR cerned with the objective study of psychothera- 
ts’ verbal operations. It represents one phase of 
i uthoris doctoral dissertation submitted to the 
ces Council of the George Washington Uni- 
1 ried (10), and was in substance presented at the 
tion Meeting of the Eastern Psychological Associa- 
mad in New York. Grateful acknowledgment is 
Phili to Professor Curtis E. Tuthill, Dr. E. Lakin 
Reine and Leon Salzman, M.D., for valuable sug- 
sons and criticisms. 
Po ile carrying out this work, the author held 
Air a successively with the Department of the 
orga orce and the Department of the Army. Neither 
nization has any connection with this research. 
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sonality and attitudes are the prime determin- 
ers of the character of his therapeutic opera- 
tions. On the nondirective side, several in- 
vestigators have given attention to the thera- 
pist’s verbal behavior (e.g., Porter 4, See- 
man 8, Snyder 9, among others), but with 
the exception of a few isolated studies, no 
systematic attempt has been made to study 
the techniques of psychotherapists not sub- 
scribing to the Rogerian frame of reference. 
The work reported by Fiedler (2) in Mowrer’s 
recent compendium represents an important 
beginning, but it must be broadened in scope 
and supplemented by a good deal of down-to- 
earth exploratory research to give us a better 
idea of what is meant by such dimensions as 
“expertness,” “ideal therapeutic relationship,” 
etc. In short, as research into the process of 
psychotherapy increases and as psychotherapy 
acquires the status of a scientific discipline, 
we may expect to see a concomitant rise in 
the number of investigations bearing upon the 
contributions of the psychotherapist to the 
treatment situation. 

In keeping with this orientation, the present 
inquiry attempts an empirical comparison be- 
tween the psychotherapeutic techniques used 
by Rogerian and psychoanalytically oriented 
psychologists. The rationale guiding this work 
may be stated thus: Techniques of psycho- 
therapy are rational and systematic procedures 
designed to produce an amelioration of the 
patient’s mental health. Every communication 
by the therapist is ideally placed in the service 
of the over-all objectives of therapy, as con- 
ceived and elaborated in the prominent the- 
ories. Techniques may therefore be considered 
as theory translated into action. Without get- 
ting embroiled in discussions about the extent 


> 


2 Hans H. Strupp 


to which Rogers’ client-centered theory is 
basically different from psychoanalytic prin- 
ciples, or whether Rogers’ theory is in fact 
nondirective, it is evident that differences in 
emphasis do exist among the major theories 
of psychotherapy. So much is certain. But 
what about theory in action? Do the opera- 
tions of psychotherapists proceed in accord- 
ance with the theoretical precepts to which 
they claim allegiance? If so, we would know 
at least that different theories lead to specific 
therapeutic procedures predictable from the 
theory, although the therapeutic effectiveness 
of any procedure is thereby no further eluci- 
dated. If not, theory would have little practical 
import for therapy. 

Investigations of the techniques of Rogerian 
counselors have shown (e.g., 4, 8,9) that they 
make considerable use of the techniques ad- 
vocated by Rogers, such as reflections of feel- 
ing, nondirective leads, etc. With respect to 
psychoanalytically oriented therapy we have 
few objective data. It is well 
course, that the ultimate emphasis 
analytic technique rests upon interpretation, 
especially of the transference situation in the 
broadest sense, However, interpretations are 
not be to made frequently, indiscriminately, 
or at all in the initial phases of therapy (3, 
ch. VIII). What techniques, then, does the 


Psychoanalytically oriented therapist use at 
the beginning of the 


known, of 
of psycho- 


questions, (d) less 
reassurance, (e) fewer instances of passive re- 


jection and outright antagonism. Analytically 
oriented therapists, on the other hand, should 
differ from Rogerians in (a) offering a larger 


number of interpretations, (b) more explora- 
tions, and (c) fewer reflective responses. , 
Finally, it was hypothesized that the varia- 
ble of personal analysis might disclose sys- 
tematic differences in verbal techniques.’ 


Method 


To study the therapist’s verbal behavior 
under reasonably standardized conditions it 
was considered advisable to avoid the com- 
plexities of the actual therapeutic situation, 
but rather to have the therapist respond to a 
carefully preselected sample of patient com- 
munications. Thus, a series of 27 short para- 
graphs of patient statements was culled from 
published therapeutic interviews and typed 
on individual cards. A bare minimum of back- 
ground information preceded each statement. 
It was stipulated that the materials pertained 
to early interviews to forestall the possible 
criticism that the interpersonal relationship 
between therapist and patient would make 
it difficult to formulate a response. The 27 
statements were regarded to be a fairly repre- 
sentative cross section of verbalizations typl- 
cally heard from neurotic patients in early 
interviews. Represented in the series were a 
variety of complaints, statements by a seri” 
ously disturbed near-psychotic patient, suicide 
threats, and other transference reactions, such 
as blocking, negativism, requests for direct 
advice, and open hostility. 

Such “miniature therapeutic situations” ob- 
viously introduce a certain degree of arti- 
ficiality and fall short of replicating the actual 
therapeutic session. While the degree of cor- 
respondence between the therapist’s actual 
operations (the criterion) and his perform- 
ance in a “test” situation should eventually 
be explored, we may, for the present, grant a 


certain conditional validity to our experi- 
mental procedure. 


It should be noted that our concern here is ex- 
clusively with but a limited aspect of the therapeutic 
Process—the therapist’s verbal contribution which is 
at no time considered coextensive with his total con- 
tribution to the treatment situation. But since tech- 
niques are described, advocated, taught, and manipu- 
lated, it is a legitimate undertaking to inquire into 
their application and to explore the extent to which 


€y are a function of the practitioner’s theoretical 
orientation, 
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Table 1 
The Sample by Experience Level and Personal Analysis 


Personal analysis No personal analysis 


Experi- Inex- Sub- Experi- Inex- Sub- 
Group enced perienced total enced perienced total Total 
Rogerian psychologists 3 2 5 1 2 3 8 
Psychoanalytically oriented 
psychologists 3 3 6 0 1 1 7 
Total 6 5 11 1 3 4 15 


i IO 


Procedure and Subjects 


Therapists who had indicated a willingness 
to participate were visited and interviewed in- 
dividually. Cooperation was surprisingly good, 
and very few of the therapists who were ap- 
proached refused. Each interview lasted about 
one and a half to two hours. 

The respondent was presented with the ex- 
perimental series of patient statements and 
requested to state what response, if any, he 
would make to the hypothetical patient. 

_ Information concerning the therapist’s train- 
ing, experience, theoretical orientation, etc. 
was collected at the end of the session. 

_ The subjects were 15 psychologists engaged 
ìn the practice of psychotherapy ; 8 were 
*Rogerians and 7 were psychoanalytically 
oriented. Practically all respondents were at- 
tached to clinics in the Washington, D. C 
area, and in addition to psychotherapy per- 
formed diagnostic and related functions. The 
data were supplemented by responses simi- 
larly collected from 25 psychiatrists and 9 
Psychiatric social workers, who constituted two 
Psychoanalytically oriented reference groups. 

Seven psychologists had more than five 
years of experience in therapy, and will be 
referred to as “experienced therapists.” Table 
1, which presents the respondents’ experience 
level, also indicates that five Rogerians and 
six non-Rogerian psychologists had undergone 
Personal analysis as part of their training. 

Ogerians and non-Rogerians appear to be 
well equated as regards experience level and 
Personal analysis.* 


heterogeneity must be as- 
ndents. There is no “pure” 
is no “pure” psychoanalyti- 


*A certain de 
gree: 

sumed among the r; 

Rogerian just as the 


Results 


Therapists’ responses were categorized by 
Bales’ system of interaction process analysis 
(1), a well-known general purpose frame- 
work for describing social interactions. This 
system commended itself for present purposes 
because of its theoretical neutrality as re- 
gards the conflicting schools of psychotherapy 
and because of the concentrated effort which 
has gone into the formulations. 

The psychologists’ responses yielded a total 
of 553 score units (mostly simple sentences 
or thought segments). The reliability of the 
categorizations was tested by several methods 
and found to be 78 per cent.’ 

Table 2 shows Bales’ 12 categories, to- 
gether with the responses of Rogerians and 
non-Rogerians assigned to each. Figure 1 
presents the same results in profile form. The 
ż values (computed by the formula for un- 
correlated percentages) indicate highly statis- 
tically significant differences between Rogerian 


cally oriented therapist. Most Rogerians must have 
come in contact with psychoanalytic concepts, par- 
ticularly those who had undergone personal psycho- 
analysis. The converse is not necessarily true. Also, 
while there is considerable diversity in psychoana- 
lytic thinking, most therapists surveyed here (in- 
cluding psychiatrists and social workers) had come 
under the influence of the Washington School of 
Psychiatry, and thus espoused neo-Freudian prin- 
ciples and concepts. The classificatory problem was 
resolved by including all psychoanalytically oriented 
therapists in one group and all therapists who ac- 
knowledged Rogerian influences in the other. 

5 Since data were collected from psychiatrists and 
social workers for related projects, the reliability 
was tested upon a stratified random sample of 20 
per cent of the cases. The reliability percentage 
figure represents the average agreement among three 
judges who independently scored 370 response units. 
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and analytically oriented therapists in almost 
all applicable categories. A chi-square test 
for the distributions is significant beyond the 
.001 level of confidence. ! 
Figures 2 and 3 attempt a comparison be- 
tween experienced and inexperienced thera- 
pists in each of the two groups. Rogerian 


therapists show a highly significant decline in 
reflective responses (Category 6) with in- 
creasing experience, and a corresponding rise 
in exploratory responses (Category 8). The 
difference in Category 12 appears to be of 
little practical importance. Chi square is again 
highly statistically significant. Differences be- 


Table 2 


Scoring Categories and Response Frequencies 


Category Interaction process 
no. analysis definition d 


“Psychotherapeutic” 


Rogerians’ 
responses 


Non-Rogerians’ 
responses 


efinition} N % N % á 
1 Shows solidarity, 


Gives reassu Tance, encourage- 8 2.6 13 5.3 1.69 
raises other’s status, ment, shows compassion, 
gives help, reward. tenderness. 
2 Shows tension release, Not applicable} 0 o0 0 o0 
jokes, laughs, shows 
satisfaction. ee 
3 Agrees, shows Passive Shows passive acceptance, 16 52 39 15.8 4.10 
acceptance, understands, understanding, is permissive 
concurs, complies. (includes silences). ** 
4 Gives suggestion, Proposes course of action, 3 1.0 15 6.1 3.46 
direction, implying defines (“structures”) the 
autonomy for other. therapeutic situation. ee 
Gives opinion, Interprets, analyzes behavior 11 3.6 25 10.0 3.10 
evaluation, analysis, patterns; thought in Process, 
expresses feeling, wish, inferential reasoning. k 
Gives orientation, Restates, clarifies, 231 75.5 35 14.2 1426 
information, Tepeats, “reflects” (Rogerian 
clarifies, confirms. response), tt 
Asks for orientation, Asks factual questions, OF” 40) 17 6.9 4.60 
information, Tepetition, expresses lack of 
confirmation. knowledge, uncertainty. ee 
8 Asks for opinion, Explores, asks for elabora- 30 9.8 88 35.6 7.37 
evaluation, analysis, tion or expression of feeling 
expression of feeling, (includes open-ended ques- 
9 Ais fog Geiss ma “nondirective leads”). 
direction, Possible o nicale] ° 2 ’ ° 
ways of action. 
10 Disagrees, Shows passive Showe Passive rejection, dis. 3 410 is. 3 3.14 
rejection, formality, belief; ignores requests or 
withholds help, complaints; thwarts, frus- 
11 Shows tension, asks for oe 
help, withdraws out of feta, NOt applicable Pied a 
12 Shows anta ‘onism, deflat i 
other’s nee defends SE son s intaga E ee = a A ee 
asserts self, cynicism, 7? 
Total 306 100.0 247 100.0 


t This column gives examples of the kinds of 


t The absence of Tesponses in these catego: 
were elicited. 


** Significant at the -01 level of confidence, 


ri 


Tesponses by therapists included in the i i = 
resp cat defined. 
‘es is probably a function of the experi ental condos ee hich re 


“mental conditions under which responses 
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tween experienced and inexperienced analyti- 
cally oriented practitioners seem to be due to 
chance. 

The final tabulation (Figure 4) shows con- 
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Fig. 1. Response distributions of Rogerian and psy- 
choanalytically oriented psychotherapists. 
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ee 2. A comparison of the response distributions 
experienced and inexperienced Rogerian psycho- 
therapists, 
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Fig. 3. A comparison of the response distributions 
of experienced and inexperienced non-Rogerian psy- 
chotherapists. 
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Fig. 4. Response distributions of analyzed and un- 
analyzed Rogerian psychotherapists. 


siderable overlap between Rogerian therapists 
who had been analyzed and those who had 
not. Noteworthy differences are observed in 
Categories 3 and 8: analyzed therapists give 
significantly fewer responses classifiable as 
passive acceptance and explorations. Because 
of the small number of clinicians involved in 
this comparison, the results must be con- 
sidered highly tentative. (Chi square was sig- 
nificant at about the .14 level.) A similar 
comparison for non-Rogerian therapists proved 
unfeasible for the same reason. 
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Discussion 


The sharp differences between Rogerian and 
psychoanalytically oriented psychologists con- 
stitute a striking finding, which in general 
confirms the predictions made from theoretical 
expositions. Thus, it is noted that Rogerians 
rely heavily on reflective techniques, with a 
corresponding neglect for other types of re- 
sponses. Non-Rogerians, while showing a pro- 
nounced predilection for exploratory responses, 
reveal more than minimal frequencies in such 
categories as passive acceptance, structuring, 
interpretation, and possibly reassurance, di- 
rect factual questions, and Passive rejection. 
Their responses are distributed more evenly 
over the range of techniques than those of 
the Rogerians and, as was shown in another 
context, closely resemble the response pat- 
terns of psychiatrists and social workers, 
These results, of course, indicate nothing con- 
cerning the relative effectiveness of these tech- 
niques, but regardless of other considerations 
there is at least the Possibility that undue 
Preoccupation with any one technique may 
lead to stereotypy. 

The data presented in Figure 2 indicate a 
noteworthy decline of responses in the Ro- 
gerians’ most favored category, which is not 
paralleled by non-Rogerians. An analogous 
difference was observed between experienced 


and inexperienced psychiatrists. This suggests 
that an increase in 


leads to a diversi 


6Tt is interesting to note that the Present fre- 


categorized 62.6 
“nondirective,” 
85 per cent. 


(no distinction was made between silent re- 
sponses and other signs of passive acceptance, 
such as “Yes,” “Mmmh,” etc.). The statis- 
tically significant difference in exploratory re- 
sponses was not observed in any other analy- 
ses. While only inadequately explained at this 
time, this finding is of significance here be- 
cause it clearly cuts across the Rogerian—non- 
Rogerian cleavage which these analyses have 
demonstrated. 

The results of this investigation leave little 
doubt that adherence to the Rogerian frame 
of reference is an important determinant of a 
psychotherapist’s techniques, transcending pro- 
fessional affiliation and experience level. Also, 
within the limits imposed by the experimental 
situation, psychoanalytically oriented psychol- 
ogists, psychiatrists, and social workers form 
a rather homogeneous group with respect to 
their therapeutic operations. Future investiga- 
tions must refine these analyses and specify 
the conditions under which a given technique 
achieves a particular therapeutic effect. 


Summary 


As one in a series of investigations to elu- 
cidate the psychotherapist’s contribution to 
the treatment situation, the present study at- 
tempts a systematic comparison between the 
techniques used by Rogerian and psychoana- 
lytically oriented psychologists in early thera- 
peutic interviews. Therapeutic responses were 
secured from eight Rogerian and seven non- 
Rogerian psychologists to a series of 27 pa- 
tient statements which had been extracted 
from actual therapeutic interviews. A total of 
553 response units was categorized by Bales 
system of interaction Process analysis. Aver- 
age rater agreement was determined to be 78 
per cent. The major results may be sum- 
marized as follows: 

1. Sharp differences exist between the re- 
Sponse patterns of Rogerian and non-Rogerian 
therapists. As might be expected, Rogerians 
show a strong predilection for reflective re- 
SPonses, with a concomitant lack of responses 
in all other Categories. Psychoanalytically 
oriented psychologists distribute their re- 
Sponses more evenly over a variety of tech- 
niques although they prefer explorations at 


Rogerian and Psychoanalytic Techniques 7 


this stage of therapy. The latter group agrees 
closely with psychiatrists and social workers 
whose techniques were investigated in related 
projects. 

2. Rogerians disclose a significant decline 
in reflective responses as the level of their 
professional experience increases. While non- 
Rogerian psychologists fail to show a com- 
parable trend, there is other evidence that an 
increase in experience leads to a diversification 
of therapeutic technique. Exclusive reliance 
on one technique appears to be a correlate of 
inexperience. 

3. Analyzed Rogerians, like other therapists 

whose training has included personal analysis, 
show significantly fewer silent responses (pas- 
Sive acceptance). 
; This study thus provides preliminary ob- 
jective evidence on the techniques of psycho- 
therapists (psychologists) who are follow- 
Ing respectively Rogerian and psychoanalytic 
Principles, and documents pronounced differ- 
ences in therapeutic technique specifically at- 
tributable to the clinician’s theoretical view- 
Point. 


Received May 10, 1954. 
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Direction of Perceived Movement in Males 
and Females’ 


Walter James Gleason 
Mental Hygiene Consultation Service, Fort Knox, Kentucky 


Rorschach notes a quality of movement on 
the inkblots which he calls flexion or exten- 
sion. He states that subjects who see exten- 
sion movements are active individuals with 
strong drive toward self-assertion. Those who 
see flexion movements are thought to be pas- 
sive, resigned, neurasthenic individuals, Ror- 
schach also quotes Oberholzer as writing that 
flexion movements in a man represent the 
feminine part of his sexuality. 

Beck has elaborated on this notion and also 
defines flexion and extension movements more 
precisely. He defines the extension M as cen- 
trifugal, as a pull away from the center. Beck 
calls the flexion M centripetal, a pull toward 


the center. He seems to agree essentially with 
the Oberholzer concept of extensor and flexor 
M representin 


8 respectively the masculine and 
feminine attitude in the basic personality 
structure. Thus Beck states that the stance 
in the fantasy activity may provide evidence 
supporting the homosexual lead. 

To check on the extensions made by Beck 
and Oberholzer, a series of 28 plates was con- 
structed with the intent to produce figures in 
which either centrifugal or centripetal move- 
ment could be perceived with equal ease, 
These plates administered to male and fe- 


1An extended re 
tained without ch 
140-F Prichard P], 
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Congress. 


male populations could then be used to test 
whether males would show a predominance 
of centrifugal movements, and the females, a 
predominance of centripetal movements. Cen- 
trifugal movement was defined as movement 
away from the geographical center of the 
plate field, while centripetal movement was 
defined as either movement toward the center 
of the plate field or that remained within the 
center of the field. Many of the designs were 
suggested by actual Rorschach movement 
stances, while the remainder were more ab- 
stract figures such as contracting-expanding 
splashes, cubes, circles, and the like. 

The plates were made into slides for group 
administration and an answer sheet was con- 
structed so that upon viewing each plate, 5 
was forced into a selection of one of two re- 
Sponses, one representing a centrifugal direc- 
tion of movement, and the other representing 
a centripetal direction of movement. The Ss 
included 101 males and 87 females from in- 
troductory psychology classes at the Univer- 
sity of Maryland. 

Chi-square analysis revealed that in no case 
did the male group exhibit a significantly 
greater number of centrifugal movement re- 
sponses than the female group. On only two 
plates were results approaching significance 
noted. Neither favored the Oberholzer-Beck 
hypothesis. Thus the fact of biological sexu- 
ality has no bearing on the perception of di- 
rection of movement on these plates. If the 
Oberholzer-Beck hypothesis is true, it woul 
Seem that more elements are involved than 
mere direction of movement. 

Brief Report 
Received August 10, 1954, 
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Ambiguity as a Therapeutic Variable 


Edward S. Bordin 


University of Michigan 


l One of the major issues in psychotherapy 
is the answer to the question of what makes 
an interpersonal relationship therapeutic in 
the sense that the relationship leads to sig- 
nificant personality changes. In an earlier 
article (3) I have presented and discussed the 
hypothesis that therapeutic relationships vary 
in more than one significant dimension. Now 
I shall pursue this point further. 

, Before we can proceed, it is necessary to 
distinguish psychotherapy + from what might 
be called therapeutic phenomena. Many inter- 
personal relationships which occur in other 
than a formal therapeutic setting result in 
personality changes. Interactions with friends, 
teachers, and others can result in considerable 
modification of the affective and motivational 
aspects of behavior patterns. However, these 
changes have not resulted from the planned 
and controlled use of these interpersonal re- 
lationships. Changes resulting under condi- 
tions of ordinary interpersonal relationships 
can be called therapeutic phenomena to dis- 
tinguish them from psychotherapy where one 
Person, the therapist, makes use of interper- 
Sonal relationships in a conscious and con- 
trolled way to lead to changes in the other 
Person’s personality. Therapeutic phenomena 
May be thought of as resulting from the co- 
incidence that one person’s natural ways of 
reacting correspond with the kinds of reac- 
tions from people which will lead to personal- 
ity change in another person. T he problem in 
the theory and practice of psychotherapy is 


to identify those characteristics of interper- 


1 For purposes of this discussion the term “psycho- 
herapy” should be read to refer to all types of 
Situations where personality modification is the goal, 
TE counseling, short-term therapy, and intensive 
a Srapy. The respective pairs of terms, “therapist” 
ae Counselor,” and “patient” and “client,” will be 
sed interchangeably within the pairs. 


sonal relationships which can make relation- 
ships therapeutic. 

A multidimensional conception of thera- 
peutic relationships is not universally ac- 
cepted. As my earlier paper suggested, Ro- 
gerian theory (11) seems to have assumed 
that there is a single characteristic of inter- 
personal relationships, namely, nondirective- 
ness or permissiveness, which can account for 
the therapeutic value of these relationships for 
all combinations of patient and therapist per- 
sonality. As a matter of fact the directive- 
nondirective dimension of therapeutic rela- 
tionships has never, to my knowledge, been 
subjected to the type of analysis which would 
permit a test of the tenability of the unidimen- 
sional assumption. Aside from this factual 
issue, it would appear that an assumption of 
unidimensionality of therapeutic relationships 
would seem to stem froma relatively simplified 
conception of personality structure and per- 
sonality change. This is an assumption which 
many will be unwilling to accept. If one 
accepts the proposition that personalities, 
whether of patient or of therapist, must be 
analyzed along multiple dimensions in order 
to be understood and that these dimensions 
will be relevant to personality development _ 
and change, then a quest for multidimensional 
characteristics of therapeutic relationships is 
indicated.” 

Several possible dimensions which might be 
relevant to the therapeutic value of relation- 
ships were suggested in the earlier paper. 
Since that time, more intensive theoretical 


2'This position does not preclude the possibility 
that the distinction between directive and nondirec- 
tive relationships refers to a particular combination 
of independent subcharacteristics. We still would 
want to study all of the combinations of character- 
istics and their contribution to the therapeutic char- 
acter of interpersonal relationships. 
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analysis accompanied by considerable direct ob- 
servation of therapeutic relationships through 
the medium of recordings, typescripts, and 
supervisory interviews has led to drastic mod- 
ification of these first tentative statements.? 
The purpose of this paper will be to present 
a theoretical analysis of one hypothesized di- 
mension, namely, ambiguity. Future papers 
will present others of the dimensions being 
formulated.* 


The Concept of Ambiguity 


Ambiguity refers to the stimulus charac- 
teristics of the therapeutic situation, of which 
the therapist is the most significant part. As 
two people interact, each defines himself to 


s object to a greater or 


facilitated the process o; 
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ae t egree; hoy "thes $ 
bility for this statement cee eo the tesponsi- 


ing formulated are the sepdi- 
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By way of topic the therapist may com- 
municate to the patient that he is supposed 
to talk about his dreams, his job, or his 
sexual relationships. The area of choice of 
topic may be even more restrictively defined, 
e.g., the patient’s relationships with his boss, 
the courses he will be taking next year, or it 
may be left more ambiguous, e.g., anything 
that is of personal concern to the patient. The 
analytic rule “tell me anything that comes to 
your mind” represents one of the least re- 
strictive and therefore most ambiguous defi- 
nitions of the appropriate topics for discus- 
sion. 

The therapist’s definition of the closeness 
of the relationship is undoubtedly influenced 
by the content of his definitions of appropri- 
ate topics. It is customary, in introducing the 
analytic rule, to talk about the therapeutic 
situation as different from and not subject to 
the usual inhibitions associated with ordinary 
social intercourse. When a therapist indicates 
that he expects the Patient to talk about very 
Personal feelings he implies that it will be a 
very personal relationship. However, many 
other aspects of the therapist’s behavior are 
Probably more important than formal “struc- 


turing” in defining the expected character- 
istics of the relationship, e.g., the counselor 
who addres 


ses his client by his first name on 
first meeting is Suggesting an adult-child or 


emotionally controlled 
objective distance js influential in conveying 
therapist definitions of the relationship. Simi- 
larly, the therapist may be quite communica- 


tive of his values or leave them relatively un- 
defined, 


Sponse. In more 


ferent Patients wi 
Some will 


and critical 
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be qualified by considerations of patient per- 
sonality factors which will be discussed in 
the next section. 

In effect, we are talking about the degree 
to which the therapist either advertently or 
inadvertently gives structure to the stimulus 
field for the patient. The analyst as a blank 
screen appears to represent an example of 
one extreme of the ambiguity-structuredness 
dimension. Through long periods of silence 
the analyst minimizes the amount of struc- 
ture the situation presents to the patient. 
His admonition “tell me whatever comes to 
your mind” gives the patient little material 
for a perception of specific appropriate con- 
tent for communication. The analyst’s po- 
sition behind the patient eliminates or mini- 
mizes the possibility of the patient’s obtain- 
ing structuring cues from facial expressions 
or other fragmentary movements. Informa- 
tion-bound counseling relationships, on the 
other hand, are good examples of extremely 
structured situations where the purposes of 
the meeting and the goals are usually both 
explicitly and implicitly defined in relatively 
definite terms and where the topic is often 
restricted by a series of very delimited ques- 
tions which can be answered “yes” or “no.” 

To summarize, ambiguity in the context 
of psychotherapy refers to a quality of the 
stimulus characteristics of the therapist and 
the therapeutic task. Ideally, the discrimi- 
nation of degrees of ambiguity would be 
ased upon the variability of responses 
among people to a given stimulus complex. 
Until now, no practical way of applying this 
direct approach to the measurement of am- 
biguity in psychotherapy has been devel- 
Oped. However, Osburn (10) did establish 
two reliable methods of measurement, one 
based upon ratings of sections of therapeutic 
teractions ranging in size from a type 
Script page to an interview unit, the other 
ased on coding of discrete categories of be- 
avior, each category weighted and then all 
combined to yield a score. These two meth- 
ods of measurement were found to yield 
Correlations with each other approximately 
qual to their reliabilities. Further 


Osburn found that ambiguity seemed to op- 
erate as a single scale, he also found that his 
raters were able to make discriminations 
only in ordinal terms. The reliability of Os- 
burn’s coding method of measurement was 
confirmed as a by-product of Dibner’s (5) 
study of the relationship of anxiety to am- 
biguity to be discussed later. 


Relation to Personality Theory 
and Measurement 


Ambiguity as a variable in personality 
theory, particularly in connection with emo- 
tional factors in perception, is already well 
known. Ambiguity is achieved by tachisto- 
scopic exposure of stimuli at speeds which 
provide decreased visual clarity. The varia- 
tions in perceptions obtained under those 
conditions are taken as reflections of or- 
ganized systems of motivations, emotions, 
and defenses (2, 4). 

Similarly, ambiguity as a factor in per- 
sonality measurement is already utilized in 
the basic theory of projective techniques." 
Projective tests have two characteristics. 
First, they require that the subject react to 
stimuli which do not have demanding struc- 
tural determinants of perception. Second, 
projective tests make possible the identifi- 
cation of the dimension of the stimulus to 
which the individual has responded and the 
content of his response. Knowing these it is 
possible to make inferences about the mo- 
tivational and emotional structure of the in- 
dividual or, in usual terms, his personality 
structure. For a long period enthusiasm for 
the projective hypothesis has led merely to 
a multiplication of types of projective situa- 
tions. More recently there have been poten- 
tially more productive studies designed to 
amplify the projective hypothesis as it ap- 
plies to personality assessment. One of the 
natural objects of study is the degree of am- 
biguity in any test situation. It seems to me 
that we can learn more by experimental 
variations within a projective test situation 
than from an unending process of devising 

Weisskdpi-Joelson (13, 14, 15) 

29 ailuR@MEA" fhis: experimental design by 


Pres s A ra È < 
ented evidence to support t! dpeathedn er ys{RPIGODE ‘the effects of various degrees 


SIS that ambiguity is a unidimens nal ghar; 
acteristic of therapeutic interviews. ‘Although 
+ pated 


as No 


5 For example;‘see Abt and Bellak (1, pp. 12-18). 
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of clarity of the human figures on produc- 
tivity in the TAT. Miller and his students 
(9) have demonstrated that a projective 
test must be studied not only in terms of 
the test stimuli but as a total situation. 
They have found that such factors as the 
personality of the examiner and the types 
of task definitions given the subject, e.g., 
“this is a test of intelligence,” or “this is a 
test of imagination,” influence Rorschach re- 
sults. 

Frenkel-Brunswik (7) has placed particu- 
lar emphasis on tolerance for ambiguity as an 
emotional and perceptual personality variable. 
She has interrelated intolerance of cognitive 
ambiguity: with emotional ambivalence and 
rigidity. Her analysis is supported by the re- 
sults of studies carried on by her and her col- 
laborators in the areas of ethnic prejudice, 
perceptual ambiguity, and rigidity in prob- 
lem solving. 


tain 
re in fact being 
liminate the re- 
S reaction, Only 


to himself as well as 
to the patient that the Patient’s reactions to 


him are controlled by irrational, infantile 
feelings. 

When we turn to nondirective theory, we 
find that being “nondirective” means, in part, 
not defining or imposing your own values on 
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the client. Also, the nondirective counselor is 
supposed to avoid “directive” leads. A direc- 
tive lead seems to be a demand for the client 
to talk about a very specific topic in restricted 
terms as contrasted with a nondirective lead 
which is a more general invitation to com- 
municate, sometimes including a relatively 
unrestricted designation of a topic. One gets 
the impression that Rogerian therapists ale 
much less ambiguous than orthodox analytic 
therapists. This impression is based on the 
fact that Rogerian therapists seem to talk 
more, particularly in the early stages of thera- 
peutic relationships. It is relatively rare for 
the Rogerian therapist to respond with silence 
to a patient’s responses. It seems as though 
the Rogerian goal of understanding the client 
or patient becomes a command to attempt to 
put into words what the patient is trying to 
Communicate whenever the patient comes to 
a stop. That this is a developmental trend in 
nondirective therapy is suggested by the re- 
sults of Seeman’s comparison of nondirective 
therapy ten years earlier with present-day 
illustrations (12). One of his findings was 
that a greater Proportion of current nondirec- 
tive therapists’ responses could be character- 
ized as clarification and a smaller proportion 
of them could be characterized as simple ac- 
ceptance. According to the meaning of these 
categories it would seem that nondirective 
therapists have tended to increase the amount 
of effort expended in verbalizing patients 
feelings and have decreased the frequency 
with which they respond with relatively sim- 
ple listening responses. This might lead to the 
Possible conclusion that nondirective thera- 
pists are less ambiguous now than they were 
ten years ago, as contrasted with the nondi- 
rectivists’ interpretation that they are under- 
standing their clients better, 


Application to Therapeutic Theory 
and Research 


The preceding discussion has been designed 
to demonstrate that ambiguity has meaning- 
ful relationships to personality theory a? 
measurement and to therapeutic theory. 1° 
this section I shall attempt to show that this 
construct leads to further expansion and syS- 
tematization as well as to the formulation 0 
testable hypotheses about therapeutic work. 
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Let us summarize and make more explicit the 
fundamental proposition which can be de- 
rived from therapeutic and personality theory, 
namely, that ambiguity in therapeutic rela- 
tionships serves three major functions. First, 
it capitalizes on the principle that ambiguous 
stimuli elicit from people those responses 
which are most heavily laden with the unique 
aspects of their life history. In other words, 
people invest ambiguous stimuli with their 
own motivational and emotional life. This 
function of ambiguity makes it possible for 
the patient, no matter how well oriented to 
reality, to bring into the therapeutic relation- 
ship his major conflictual feelings no matter 
how unaware he is of them. This, we think, is 
identical with the Freudian concept of trans- 
ference so that ambiguity is one of the facili- 
tating factors in the appearance of transfer- 
ence phenomena in therapeutic relationships. 
Second, by leading to this investment of the 
patient’s motivational and emotional struc- 
ture, ambiguity makes it possible for the 
therapist to understand more fully and more 
deeply the mainsprings of the patient’s ac- 
tion. Third, by being ambiguous, the thera- 
Pist provides a background against which 
the patient’s irrational feelings will be more 
Clearly etched and therefore more readily 
brought to awareness. Ambiguity helps to 1m- 
Sure the effectiveness of the well-timed in- 
terpretation. 

I shall outline four different areas for which 
the concept of ambiguity can lead to further 
Clarification of therapeutic phenomena and 
Point the way to significant therapeutic re- 
Search. 

1. The attempt to master the complexity 
of therapy makes us susceptible to reduction- 
istic approaches such as would be reflected in 
ruling that all relationships to be therapeutic 
Must be ambiguous for the patient. But the 
functions of ambiguity in therapeutic rela- 
tionships must be balanced against our con- 
Ceptions of the role of anxiety. While anxiety 
1S considered a necessary ingredient of effec- 
tive therapy, our present knowledge leads us 
to believe that there is an optimal level of 
anxiety for each patient and that as the level 
of anxiety begins to exceed that point, the pa- 
ient starts to be overwhelmed by his anxiety 
and eventually all of his energies are con- 


sumed in self-preservative efforts, leaving no 
energy for therapeutic movement. 

Psychoanalytic personality theory provides 
a basis for expecting that anxiety will be posi- 
tively related to ambiguity. This theory as- 
sumes that people try to defend themselves 
against anxiety associated with conflictual im- 
pulses by denying to awareness or distorting 
those stimuli associated with the impulse. 
Where the stimuli are ambiguous, the dis- 
criminative processes “necessary for defense 
are hampered and greater anxiety will result. 
Dibner (5) found evidence to confirm the de- 
duction that anxiety will be positively related 
to ambiguity in an interpersonal relationship. 
He applied Osburn’s (10) methodsof measur- 
ing ambiguity to admission interviews with 
patients referred to the psychiatric service of 
a general hospital. His interviewers, clinical 
psychologists, carried out half of their inter- 
views with a set to be ambiguous and the 
other half with a set to be structured. Their 
compliance with the instructions was con- 
firmed by measures of ambiguity applied to 
their interviews. 

From this confirmed hypothesis of a posi- 
tive relationship between ambiguity and anx- 
iety one can move to the further deduction 
that the more intense the person’s conflict 
and the weaker his discriminative and defen- 
sive capacities, the greater will be the anxiety 
experienced at any given level of ambiguity. 
In other words, patients, varying in their per- 
sonality structure and particularly in the flexi- 
bility and effectiveness of their integrative 
processes, will vary in the amount of threat 
and anxiety experienced in ambiguous inter- 
personal relationships. Thus, it becomes neces- 
sary for the therapist to relate the degree of 
ambiguity to the level of anxiety which will 
be optimal for the particular patient. Perhaps, 
one of the critical factors distinguishing effec- 
tive therapeutic work with schizophrenic pa- 
tients from work with neurotics is the lesser 
degree of ambiguity which is demanded in re- 
lationships with schizophrenics. This distinc- 
tion would be consistent with the assumption 
that schizophrenic personalities are character- 
ized by inadequate and weak ego-integrative 
abilities. The schizophrenic needs help and 
encouragement to increase his contact with 
reality. Even when presented with relatively 


14 Edward S. Bordin 


unambiguous stimulus situations, he is likely 
to react in purely idiosyncratic personal 
terms. Fromm-Reichmann (8) has taken a 
similar position when she holds that the ana- 
lytic free-association process was inappropri- 
ate for schizophrenic patients. 

In looking at ambiguity as a factor in the 
therapeutic relationship, we must not over- 
look the fact that the therapist may also be 
subject to its anxiety-provoking effects. In 
many cases, the structuring of the relation- 
ship comes from the therapist’s anxiety and 
discomfort in too free a relationship, one in 
which he is not able to control and foresee 
the exact direction of the patient’s reactions.* 

2. As was suggested in our preceding dis- 
cussions of the functions of ambiguity, we can 
hypothesize that the intensity of the transfer- 


Person and the gr 
to react realistica 
the relationship 
tensity of transference, 


g, “do not try to make the 
just speak out in re- 
The implication is 
ect the client from 
ildlike relationship 
ted minimally anx- 
ing to accept. His 
£ This hypothesis is to 


be tested in a study planned 
by David Rigler. i 


slight incapacities will not provide sufficient 
motivation to compensate for the loss in self- 
esteem in accepting such a relationship. It 1s 
likely that this characteristic of less ambi- 
guity will take the form of focusing reactions 
by the counselor designed to help the client 
restrict self-exploration and self-expression to 
those areas of emotion and motivation which 
are specific to a given problem situation, e.g., 
making a vocational decision. These two fac- 
tors then, the need to control transference 
and the kind of relationship acceptable to the 
counseling client, Suggest that counseling re- 
lationships will be characterized by less am- 
biguity than is true in psychotherapy. Coun- 
seling and Psychotherapy have been difficult 
to differentiate. If ambiguity is, in fact, one 
variable on which they can be differentiated, 
it will still be difficult to differentiate them 
dichotomously because therapeutic relation- 
ships will probably not distribute themselves 
in a clearly discontinuous manner. 

4. On first analysis, I expected that psy- 
chotherapy would be characterized by de- 
creasing ambiguity as the relationship pro- 
gressed. This expectation was based on the 
notion that even where the therapist imposes 
a strict free-association process, eventually he 
does begin to communicate interpretively to 
the patient, thus giving greater structure to 
himself and his reactions to the patient. In- 
evitably with time, the patient has the oppor- 
tunity to obtain cues about the therapist and 
his expectations which define him more con- 
cretely. However, Osburn (10) obtained nega- 
tive results when he tested this hypothesis in 
studying a sample of counseling relationships. 
One way to interpret these results is that 4 
revision in theory is indicated, However, these 
negative findings do not in themselves in- 
validate our first hypothesis. The negative 
findings could be due to the fact that this 
hypothesis is not applicable to counseling 
situations, but only to those situations char- 
acterized by greater ambiguity. If much more 
intensive therapeutic situations were subjecte 
to analysis, we might then expect to find that 
the interpretive Process has served to struc- 
ture the situation to an increasing extent a5 
therapy progressed, 

Even though the above rationale retains the 
original prediction about the trend of ambi- 


l 


Ambiguity as a Therapeutic Variable 15 


guity in therapy, the further examination of 
the issue occasioned by Osburn’s results has 
led to certain additional hypotheses. While to 
an observer the stimulus character of the 
therapeutic situation becomes increasingly 
structured as a function of increased interpre- 
tive effort, the dynamics of the situation may 
be such that, for the patient, the ambiguity 
has not decreased. When a therapist’s inter- 
pretation is experienced by the patient as an 
increase in intensity of his awareness of him- 
self, it will be the patient, himself, as a stimu- 
lus object which becomes more structured, 
not the therapist. When the therapist points 
Out to the patient the many ways in which he 
is defending himself against passive impulses, 
the patient experiences this as, “Yes! I feel 
dependent, I want to be dependent and I am 
afraid of these feelings,” rather than, “He 
thinks I am dependent and that I am afraid 
of these feelings.” Such will be the stimulus 
Situation for the patient when he is at a stage 
where he is rushing ahead toward self-discov- 
ery. But there are also stages where the ap- 
Proaching awareness is freighted with irra- 
tional fear and the patient is actively seeking 
to avoid it. At these times the confronting 
type of interpretation, even when effective, is 
likely to be experienced as indicating to the 
Patient what the therapist thinks of him 
rather than as a characteristic of himself, thus 
Structuring the situation. Similarly, inappro- 
Priate interpretations will have the same effect. 


Summary 


In this paper, the concept of ambiguity as 
one characteristic of interpersonal relation- 
ships relevant to their therapeutic effect has 
been outlined. Ambiguity is a quality of the 
Stimulus characteristics of the therapist and 
the therapeutic task which permits patients 
to vary their perceptions and responses to the 
therapist as a function of their personality 
structures. Methods of measuring this quality 
ave been developed and applied in research 
on psychotherapy. The previous explicit and 
implicit uses of this concept in personality 
theory and measurement and in theories of 
Psychotherapy have been reviewed. Finally, 


predictions were made about the functional 
relationship between this variable and ther- 
apy with schizophrenics, the experience of 
anxiety, the distinctions between counseling 
and psychotherapy, and about its relation- 
ships to interpretation. 


Received May 21, 1954. 
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Verbal subtest. The mean IQ difference was 
8.07. 


IQ for men- 2. Mentally defective children classified E 
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A Systematic Approach to the Construction of 
Hypotheses About the Process of Psychotherapy 


Jum C. Nunnally * 


University of Illinois 


Most hypotheses about psychotherapy come 
from the therapist’s recollection of the process 
in individual cases. This procedure has the 
weak points of being dependent on memory 
and lacking in statistical aids to analysis. The 
method presented here offers a means of 
codifying the therapist’s impressions at vari- 
ous points in the therapy. Trends in the data 
can be easily charted and it is possible to 
obtain factors and relations among factors of 
which the therapist himself is not aware. The 
Method deals with the therapist’s impressions 
and in that sense is subjective. The purpose 
of the method is to generate some operational 
hypotheses about the process of psychotherapy 
that can be verified in other experiments. 

If we assume that the therapist judges some 
client behaviors to be more important or mM- 
dicative than others, and that these “im- 
Portant” behaviors have a generality from 
Case to case, a “universe” of relevant indi- 
cators could be defined for the individual 
therapist. Samples from the universe of be- 
haviors could be treated statistically. Stephen- 
Son (2, 3) has developed a method for work- 
ing with such samples. The method requires 
that the sample be rated along a continuum 
relative to an “instructional set.” The scores 
Obtained are susceptible to the ordinary sta- 
tistics of correlation and # test and to the 
elegancies of factor analysis and analysis of 
Variance. 

The method being recommended would 
Start with a concrete therapy case—any case 
Would do. The therapist’s collection of “im- 
Portant behaviors in therapy” would be repre- 

1Grateful acknowledgment is given to Dr. Carl 

Ogers for his part as therapist in the experiment 
and for his help in developing the ideas presented. 
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sented in a sample. These could be such as 
“acted casual and indifferent about his prob- 
lems,” “asked many questions about my per- 
sonal life,” and “spent much time in thanking 
me for the help.” A standard sample could be 
made for the more general approaches, such 
as Freudian, client-centered, and Adlerian; 
but logically each therapist’s particular no- 
tions could be represented. 

The logic of sampling stimuli, in this case 
statements about therapy, is similar in prin- 
ciple to the more conventional sampling of 
people. First, it is necessary to define the 
sampling unit and the universe to be sampled, 
here Rogers’ notions about therapy (1). If 
there is a formal theory involved in the ex- 
periment, it can be represented by “effects” 
and “level” in factorial design. When there is 
no formal theory involved in the experiment, 
as in the present case, the sampling follows 
principles of randomization. The first step in 
this procedure is to make an exhaustive collec- 
tion of the statements in the specified uni- 
verse. This larger collection of statements is 
then randomly sampled in order to obtain a 
manageable number for the experiment. All 
of the conventional sampling statistics then 
apply to the relations between the experi- 
mental sample and the parent collection of 
statements. If the parent collection of state- 
ments has been sufficiently exhaustive, there 
is reason to believe that the experimental 
sample will be representative of the defined 
universe of statements. 

The experimental design would require the 
therapist to describe the therapy at regular 
intervals with the trait sample. At the con- 
clusion of therapy, the obtained Q-sort de- 
scriptions could be intercorrelated and factor 
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analyzed. The nature of the factors and the 
pattern of loadings would Provide a sounder 
basis for theorizing about the therapy process 
than previous procedure. 

The example to be described was taken 
from the case of a young woman who par- 
ticipated in 47 interviews of client-centered 
therapy. The trait sample was collected from 
Client-Centered Therapy (1), largely from 
Chapter 3. The 60 statements? obtained were 
balanced Positively and negatively to repre- 
sent the appearance of an important behavior 
and its opposite. The following are examples 
of the statements included in the sample: 

1. Feeling confused al 

of her. 

2. Wanting to impress and please therapist. 


Bi Wondering how change can come about, 
4. Struggling to express herself, 


bout what others Teally think 


: 2, respectively, 
8lves a more complete 


the middle of t 
e con 
muum were neither characteristic nor un 
characteristic of the in ervjew 
hi 


? The limited number of soi 


the therapist's time and 


25, 38, and 47. The eight descriptions, each a 
variate in the experimental design, were inter- 
correlated * and factor analyzed (see Tables 
1, 2, 3, and 4). The two factors obtained were 


Table 1 


Intercorrelations Among Sorts 
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2 18 — 

3 -23 51 — 

4 —08 61 65 — 

5 —21 35 64 56 — 

6 —45 01 54 28 54 _ 

7 =M 39 53 56 35 he 

8 ~5£~-21 36 02 32 p 2 = 


Note.—Decimal points omitted. 


Table 2 


Centroid Factor Matrix* 


Sort I 1 est. A? 
il —39 50 40 43 
2 43 67 63 64 
3 84 18 74 73 
4 70 52 76 74 
5 69 06 48 50 
6 74 —41 72 72 
7 63 11 41 44 
8 55 —67 75 71 


Note.—Decimal points omitted, is was 
age hurstone's (5) method of centroid factor analysis wa 
used. 


* Because of the use of 


for all of the sorts, the Product-moment correla- 
tion coefficient can be taken as follows: r=1— 
2) differ- 


Tepeating a Particular sort with the 
after 


reliability will 
communality, 


assumption that the 


at least as high as the median 
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Table 3 


Distribution of Second-Factor Residuals* 


r Frequency 


Ore 


12 1 


Note.—Decimal points omitted. 
Signs being ignored. 


Table 4 
Rotated Orthogonal Factor Matrix 


Interview Sort it I’ 
1 1 —28 —55 

4 2 53 —57 

7 3 85 —03 

11 4 77 —37 

15 5 67 07 

25 6 65 53 

38 7 63 00 

47 8 42 7S 


Note.—Decimal points omitted. 


Placed through one orthogonal rotation ® to 
“sharpen” the relationships made apparent by 
the factors. Each factor can be considered an 
effect” with the loadings measuring the ex- 
tent to which the therapist judged each ef- 
fect to dominate the separate interviews. 
From factor scores obtained for each of 


. "In connection with the rotational problem a 
It is interesting to note that principles of “simple 
Structure” do not apply to factor matrices resulting 
from the use of this method. It would be difficult 
to conceive of the variates here being segregated in 
Clusters in the vector space. This would mean that 
_ `€ client moves along under one set of conditions 
and then suddenly jumps to a wholly different set 
of reactions. The solution found here, where the 
Variates are distributed continuously through the 
Vector space, is more likely- . 
€ Factor arrays are obtained by weighting the vari- 


ates by the formula qa (4, Appendix XX) 


and averaging the item scores across variates. 


the traits, the following traits are found to be 
high, positively and negatively, in factor I’: 


Factor I’ 
Most Characteristic 
Experiencing ambivalent attitudes toward self. 
Experiencing the therapist as accurately understand- 
ing. 
Experiencing warm rapport with therapist. 
Feeling relieved to have an hour of her own to just 
do what she likes. 
Wondering who and what she really is. 
Experiencing the therapist as interested and wanting 
to understand. 
Feeling skeptical of the “validity” of her own experi- 
ence. 


Most Uncharacteristic 


Feeling annoyed with therapist. 

Feeling interest and concern for the therapist as an 
individual. 

Feeling that the whole effort is futile. 

Worrying about how the therapist sees her. 

Feeling that others should change to make her lot a 
more comfortable one. 


The items characteristic and uncharacter- 
istic of factor II’ are as follows: 


Factor II’ 
Most Characteristic 


Experiencing real happiness. 
Perceiving self from values rooted in primary ex- 

perience. 
Experiencing comfort in being her real self. 
Feeling pride in assuming responsibility for self. 
Working from new insights to reoriented behavior. 
Experiencing progress in therapy. 

Most Uncharacteristic 


Wondering what the therapist expects of her. 

Perceiving self in terms of values introjected from 
others. 

Feeling difficulty in talking about self. 

Feeling that she just isn’t capable of facing her 
problems. 

Wanting the therapist to assume the burden of ef- 
fort—wanting key to problems. 


Factor I’ could be interpreted as a client- 
therapist interpersonal activity concerned with 
the development of trust, faith, and warm 
emotions. Factor II’ is more intrapersonal for 
the client, aimed at free exploration and self- 
trust. It is interesting that the therapist sees 
the client at her happiest when factor II’ pre- 
dominates, and ambivalent about herself when 
factor I’ is the strongest influence. The thera- 
pist apparently does not think of the warmth 
in factor I’ as directed toward himself as an 
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individual. Note the statement “feeling in- 
terest and concern for the therapist as an in- 
dividual” appearing as the second most un- 
characteristic trait in factor I’. 

Both factors are in the negative at the be- 
ginning of therapy: there is neither interper- 
sonal nor intrapersonal “good-will.” Factor 
I’ becomes positive on the second sort (the 
fourth interview), reaches a maximum on the 
third sort, and gradually declines to the close 
of therapy. The implication is that behaviors 
relative to interpersonal warmth grow and 
then decline, perhaps necessarily so in the 
successful therapy. 

Factor II’ is less steady in its trend. It is 
not until the sixth sort that the factor is sig- 
nificantly positive. It becomes zero again in 
the seventh and rises to its maximum in the 
last interview, Rising later than factor G 
factor II’ can be construed as dynamically 
closer to the conceived basic process of ther- 
apy. Factor I’ becomes significantly positive 
in the fourth interview (second sort), but it 
is not until twenty-one interviews later that 
factor II’ comes into play. 

The analysis raises the following sorts of 
questions: 

„1. What behavior on the Part of the thera- 
Pist is necessary to bring each of the factors 
about? 

à 2. Would it be possible to have factor I’ 
in the negative and factor II’ positive (would 
it be Possible for the client to actively dislike 
and distrust the therapist, yet freely to ex- 


cessary part of factor 


l necessary part of I’ or 
can these relationships be better explained by 
the expectations of the therapist? 


Jum C. Nunnally 


4. Could the prolonged and undiminishing 
preocupation with factor I’ prevent the self- 
trust and self-exploration deemed necessary 
for therapy? 

5. Would these factors arise in other ther- 
apies done by therapists of different orienta- 
tions? Would the differences be reflected 
linguistically (as shown by the “important 
behaviors included in the particular therapist- 
sample) more than in the nature of the fac- 
tors obtained? 


Summary 


A method has been shown for systemati- 
cally studying the therapist’s impressions 
about the process of psychotherapy. It en- 
tails a Q-method (2, 3) treatment of samples 
of “important behaviors in therapy” taken 
from current theoretical works. The approach 
allows the therapist’s observations to be con- 
veniently recorded and analyzed by appropri- 
ate statistics. The purpose of the method is 
to generate some more operational hypotheses 
about the therapy process than presently 


exist. One case is analyzed to show the 
method at work. 


Received May 17, 1954. 
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e amination of the recent psychological 
oe ure bears witness to the fact that an in- 
Bettas amount of research attention is being 
23 7 ig the study of social perception (1, 
Peck. he 6, 7, 12, 13, 15, 16). This trend in 
encom 1 interest would seem to be a natural 
Seca, of the emphasis placed on in- 
alit ‘in relations in contemporary person- 
vad eory and psychiatric practice. With- 
aa most investigators of personality 
as „agree that effectiveness of social rela- 
GN is an important component of general 
pa ental adjustment, and that accurate 
satisf perceptions should be conducive to 
Eoy social relations. Despite agree- 
—— regard to the importance of this phe- 
at th on, commonly termed social perception; 

e present time the psychologist 1S faced 
sie multiplicity of unsolved problems con- 
Ebute relations between personality at- 
ie es in the perceiver and his evaluative 
oS ations of other persons in his social 
min The present investigation Tep- 
und S an attempt to contribute to further 

erstanding of these relations. 

this ore specifically, the twofold purpose of 
Rae a, is to develop an objective tech- 
abper or investigating personality and socia 
ions ception, and to test a series of predic- 
ego pertaining to relations between subjects 

Structure, their apperceptions © the 


Gm 
Tent investigation, conducted at the Harvard 
: hele Clinic under the direction of Dr. Henry 
cial ane, was facilitated by the Laboratory of So- 
Search ions. It was supported in part by a re- 
Brant Maa from the Rockefeller Foundation, and 
Health, woo from the National Institute of Mental 
Wishes to, S. Public Health Service. The author 
Who a E2 XPress his appreciation to Dr. Murray, 
the p laboratedi sec deal À 
evaluatic ct Questionnaire, and provided the clinical, 
ons of egþ structure. a'd 
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world, and their estimates of other persons’ 
apperceptions. Throughout this presentation, 
the term apperception will be used in place of 
the more common term perception. By use of 
this concept we do not wish to give the im- 
pression that we are exploring some novel 
area of investigation. The focus of this re- 
search is definitely on the problem area that 
in the bulk of the literature is labeled social 
perception. Our choice of the concept apper- 
ception is in accord with the distinction be- 
tween perception and apperception made by 
Murray (9), in which the latter term is used 
to designate the process whereby meaning is 
assigned to a physical stimulus, and includes 
such things as understanding, interpretation, 
and classification. In the present study ap- 
perception refers specifically to a perception 
involving an evaluative interpretation of 
situations and people in the perceiver’s world. 


Method 


Subjects 

The subjects were 20 Harvard undergradu- 
ates who volunteered to participate in an in- 
tensive study of personality. These subjects, 
selected from a large introductory course in 
psychology, were paid for their services at the 
current student employment rate. They were 
selected with the goal of obtaining a group of 
young men with varied backgrounds, interests, 
abilities, and personalities. 


The Affect Questionnaire 

Description. The Affect Questionnaire was 
designed to reveal three things in regard to 
certain critical dispositions of personality: 
a) the relative amount of the disposition in 
the suljject’s personality; (b) the relative 
< saat of the disposition he apperceives in 
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the personalities of other people in his social 
environment; and (c) his evaluation (posi- 
tive-negative) of the given disposition. The 
eight dispositions measured by this instru- 
ment are: sociocentricity, optimism, trust, 
egocentricity, pessimism, distrust, anxiety, and 
resentment. Of these dispositions, the first 
three are “positive” or socially desirable, and 
the last five are “negative” or socially un- 
desirable. 

There are three forms of the Affect Ques- 
tionnaire, which are identical in content but 
differ in instructions. The content consists of 
ten statements designed to relate to each of 
the eight dispositions, making a total of 80 
items. For each disposition a great many 
statements indicative of evaluative appercep- 
tions of the world and its people were writ- 
ten; some were original Constructions by the 
experimenters, and others were culled from 
sources such as Stevenson’s The Home Book 


of Quotations (14), and Murray’s Explora- 
tions in Personality (10). Fr 
items we selected 


1. The most Profound haj 
Ppiness is reserved for 
those who icati 
Pati are capable of selfless dedication to a 
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2. No longer can a young man build his character 
and his hopes on solid ground: civilization is crum- 
bling, the future is dreadfully uncertain, and his life 
hangs by a thread. 


3. People will be honest with you as long as you 
are honest with them. 


4. A man who never gets angry at anything or 
anyone is not likely to be treated with respect. 

5. There are days when one awakes from sleep 
without a care in the world, full of zest and eager- 
ness for whatever lies ahead of him. 


6. Beneath the polite and smiling surface of man’s 
nature is a bottomless pit of evil. 


7. There are times when it is absolutely necessary 


to use other people as tools in the accomplishment 
of a purpose. 


8. The real substance of life consists of a proces- 
sion of disillusionments, with but few goals that are 
worth the effort spent in reaching them, 


Administration. The instructions require the 
subject to rate each statement by marking 
the appropriate point on a 6-point scale, run- 
ning from “strongly disagree” to “strongly 
agree.” He responds to these statements un- 
der each of the three following conditions con- 
sidered in this order: (a) the way he thinks 
the “average Harvard student” would rate 
them; (b) the way he himself rates them; 
and, finally, (c) the way he thinks his “ideal 
Person” would rate them. In other words, first 
the subject is presented with a copy of the 
questionnaire with mimeographed instructions 
to respond to each statement the way he 
thinks the average Harvard student would re- 
spond to it. When he has completed this task, 
he is presented with another copy of the 
same questionnaire, only this time the in- 
structions state that he is to indicate his own 


Pee Table 1 
ank-Order Correlations (Rho i isposi 
(Rho) Between Scores on the Eight Dispositions on the Affect Questionnaire 
(N= 20) 
Disposition Optimism Pessimi Seco: Ego- 
imism i ii E 
su Trust Distrust centricity centricity Resentment 
Optimism 
Pessimism -=A 
Trust +.43* — .64*** 
Distrust —Al* +.84%8% 824+% 
Sociocentricity +.29 —.40* ES ue 
Egocentricity =10 +.76*** — 64% ate 
Resentment —.09 +.59*+* = "38% Po — 526 
Anxiety Se) dae Fim DS sae 
: SAO aoe +4.67% +.58*** 
e Sidaificant beyond the .05 level for a one-tailed test, 


igni yond the .01 level for a one-tail 
Significant beyond the .005 level for a one banat 
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personal feeling of agreement or disagree- you would most like to have in your own 
ment with each statement. Finally, he is pre- personality.” 

sented with a third copy of the same ques- Scoring. Separate scores were computed 
tionnaire, and this time he is instructed to, from responses elicited under the three dif- 
‘Rate the following statements as you be- ferent conditions by the same scoring system. 
lieve the ideal person would rate them. The The response to each statement was scored 
ideal person may be real or mythical, living from 1 to 6, depending upon the degree of 
or dead, or purely imaginary. This person agreement indicated by the subject, with com- 
should be someone admirable in your eyes, plete disagreement receiving a score of 1, and 
someone who possesses the attributes which complete agreement receiving a score of 6. 


CALLOW 


Pess Res Anx 


Soc Tr Opt Ego Dist Pess Res Anx Soe îr Opt Ego Dist 


Pess Res Anx 


Anx Soc Tr Opt Ego Dist 


“0c Tr Opt Ego Dist Pess Res 


Dist Pess Res Anx 


Soc Tr Opt Ego Dist Pess Res An Soc Tr Opt Ego 


o———? Self 
»----- x Average Harvard Student 


a— - —— Ideal Person 
and their abbreviations, indi- 


fis age . ays 
. 1. Aff ; ; h conditions. Dispositions, dt nd 
X eck res under three s À 
(ae on the oe peer Enis: sociocentricity (Soc); trust (Tr); optimism (Opt); egocentricity 
= ment (Res); anxiety (Anx). 


distrust (Dist); pessimism (Pess) ; resent 
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Scores assigned to the ten items representa- 
tive of each of the dispositions were then 
summed, resulting in a total score for each 
separate disposition. 

The statistical finding of highly significant 
intercorrelations between these scores, pre- 
sented in Table 1, led to the formulation of 
a syndrome for which the term alienation 
seemed most fitting. This syndrome is com- 
posed of the following five interrelated dis- 
positions: egocentricity, distrust, pessimism, 
anxiety, and resentment. Our findings indi- 
cate that subjects who are high on any one of 
these dispositions tend to be high on all of 
them. The subjects were rank ordered in 
of alienation evi- 
of agreement with 


sis. Visual inspection of the 
graphs presented in Fig. 1 indicates marked 
individual differences, B 


Lookout, who is the hi 
self-alienation, 
age Harvard student as only 
tion than himself, and that 


the ideal Person, 
between these sco: 


c sc 
three different conditions, Although Pie the 
report the focus is on hypothesis testin; 

diagnosis of individual person. gone 


c alities, it į 
ing to note that the impressions gained 
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tion of these profiles are, in most cases, in keeping 
with diagnoses based on intensive analysis of data 
secured by means of a variety of standard clinical 
procedures. At this point, we wish merely to point 
to the interpretive possibilities of the individual pro- 
files, and suggest that eventually this procedure may 


Prove to be an efficient and fruitful method for as- 
sessing personality. 


Ego Structure 


Before being accepted as a research sub- 
ject, each individual underwent a brief fact- 
finding interview with an experienced clinical 
psychologist. At a later date, after reading the 
detailed autobiography written by each sub- 
ject, this psychologist conducted a second per- 
sonal interview. His clinical evaluations, based 
on the findings from the autobiography and 
the two interviews, were expressed by rank 
ordering the subjects in terms of “ego struc- 
ture.” This concept of “ego structure” or “ego 
strength” has been defined in detail by Mur- 
tay and Kluckhohn (11). There is a good 
deal of clinical evidence of a high degree of 
interdependence between ego structure, a 
therein defined, and good personal and social 
adjustment. In the present study, ego struc- 
ture has been taken as an indirect measure of 
adequacy of adjustment. 


Hypotheses, F indings, and Discussion 


The highly significant intercorrelations be- 
tween subjects’ self scores on the five negative 
dispositions, which comprise the syndrome 
termed alienation, led to the formulation of 
several hypotheses pertaining to personal ap- 
perceptions and social apperceptions of peo- 
ple who are high on alienation. 

Hypothesis T: Subjects who are high on the 
syndrome of alienation will be less accurate 
in their social 
who are 1 

In ord 


an index of accuracy of 50- 
- One criterion of accurate 


ons of one’s fellowmen. If one is to have 
satisfactory interpersonal relations, he must 
be sensitive to the feelings and attitudes of 
the People in his environment. The more onè 
distorts, or Misperceives, the personalities of 


Alienation, Social Apperception, and Ego Structure 25 


those around him, the less likely he is to make 
a good adjustment to his surroundings. 

_A measure of accuracy of social appercep- 
tion would be provided by comparing the 
subject’s apperceived “average Harvard stu- 
dent’s” responses with the actual average 
Harvard student’s responses. To arrive at 
Scores representative of the mythical average 
Harvard student’s actual responses, the scores 
obtained by our subjects under the condition 
of their own self-agreement or disagreement 
with the statements were averaged. Natu- 
rally, our sample is small, and though selec- 
tion procedures were designed to secure a 

eterogeneous group, it is possible that the 
average scores for this group are actually not 
close to the “true” average of the Harvard 
College population. Therefore the results pre- 
Sented here may well not represent the final 
pad on this matter. But, with this qualifica- 
nae in mind, the discrepancy between each 
Pa ject’s estimate of the responses of the av- 
pe person and the actual responses of the 
PE nee person was taken as a measure of ac- 
thi acy of social apperception. That is, the less 

č S discrepancy, the more accurate the sub- 
Ject’s social apperception. 
test Hypothesis I, the subjects 
a an on the syndrome of alienation, 
ah ed according to the degree of discrep- 
So between their estimates of the average 
as the actual obtained average. The rank- 
is Si correlation coefficient (tau = + .142) 
th, the predicted direction, but does not at- 
ea nee .05 level of significance. All statisti- 
ia a ungs reported in this section arè shown 

able 2, 

The failure of this hypothesis to be con- 
‘med led to the formulation of the following 
YPothesis: 

ale rbothesis II: Subjects who are low on 
ae will apperceive the average Har- 

4 student as low on alienation, and those 
Aa are themselves high on alienation will 

aoe the average Harvard student as 

8 on alienation. 
tea order correlation between r 
on th own rank on alienation and their rank 
ek le basis of the amount of alienation ap- 
at t aN in the average person 1s significant 

e .003 level (tau = + .453), which con- 


tms Hypothesis II. 


were 
and 


the sub- - 


Table 2 


Self-Alienation on the Affect Questionnaire Correlated 
with Other Measures on the Affect Question- 
naire, and with Ego Structure Based 
on Clinical Evaluation 


(N = 20) 
Correlation Level of 
(tau [8]) with signifi- 
Measure self-alienation  cance* 
Alienation of apperceived 
“average Harvard student” +.453 .003 
Discrepancy between self and 
apperceived “average Har- 
vard student” +.429 .005 
Discrepancy between self and 
the ideal person +.516 -001 
Inaccuracy of social apper- 
ception +.142 142 
—.411 -006 


Ego structure 


* One-tailed tests of significance. 


These findings suggest that there are inac- 
curacies in the social apperceptions of both 
low-alienation subjects and high-alienation 
subjects, with a trend in the direction of a 
higher degree of accuracy in those subjects 
who are low on alienation. Although there is 
not a significant association between aliena- 
tion and accuracy of social apperception, con- 
firmation of Hypothesis II indicates that the 
type of apperceptual error is significantly dif- 
ferent in lows and highs, with subjects who 
are themselves low on alienation perceiving 
other people in their environment as low on 
alienation, and those who are high on aliena- 
tion perceiving others as high on alienation. - 
In other words, defining “better” and “worse” 
in terms of cultural sanction and social ac- 
ceptability, low-alienation subjects see people 
as better than they really are, and high- 
alienation subjects see people as worse than 
they really are. 

This phenomenon provides a vivid example 
of the operation of self (supplementary) pro- 
jection, which is the tendency for people to 
perceive in others those things that are actu- 
ally in themselves. In classic Freudian termi- 
nology the concept of projection was em- 
ployed solely to describe the attribution of 
one’s negative, undesirable traits on to other 
people. But the present results suggest that 
the concept of projection is applicable to posi- 
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tive attributes as well as negative attributes, 
with happy, contented, well-adjusted indi- 
viduals tending to perceive others as similar 
to themselves, and, consequently, seeing them 
as less alienated than they really are. Those 
who are low on alienation look around them 
and see a lot of trustful, happy, sociocentric 
human beings, whereas those who are high on 
alienation look at these same people and de- 
cide that they are self-centered, resentful, 
anxious, and unhappy. 

In the attempt to discover additional rela- 
tions between alienation and social appercep- 
tion the following hypothesis was tested: 

Hypothesis III: The degree of negative dis- 
crepancy between the subject’ 
and the responses he attribu 
age Harvard student will be 
jects who are high on alienati 
jects who are low on alienati 

There are two ways to re 
dicative of ne 
to apperceive 
being higher 


S own responses 
tes to the aver- 
greater in sub- 
on than in sub- 
on. 

ceive a score in- 
gative discrepancy. The first is 
the average Harvard student as 
on a positively evaluated per- 
is the self, and the 
he average Harvard 


! negatively evaluated 
Personality disposition than is the self, 


relationship 
he compari- 


: with aliena- 
s ideal person, 


The following hypothesis is Concerned with 


this relationship: 
Hypothesis IV: The 


tion. 

To test this hyp 
negative discrep 
ideal person was 


othesis, rank on amount of 
ancy between self and the 
correlated with rank on self- 
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alienation. The resulting coefficient (tau = + 
-516) is highly significant, and confirms the 
above hypothesis. This finding confirms the 
widely held belief that an important cor- 
relate of unhappiness, and probably malad- 
justment, is the perception of the self as fall- 
ing below one’s standards and ideals. , i 

As alienation is believed to be a sign he) 
emotional maladjustment, it seemed desir- 
able to correlate rank on self-alienation Lips 
some independent measure of adequacy 0 
personal and social adjustment. The measure 
selected for this purpose is the psychologist’s 
rank order of the subjects in terms of ego 
structure. With these two measures, the fol- 
lowing hypothesis was tested: 

Hypothesis V: Subjects who are low on ego 
Structure will be high on the syndrome 0 
alienation. 

The predicted negative association was 
found (tau=—.411, p= .006) indicating 
that subjects who view the world and theif 
relationship to it in a negative light have 
weak ego structure (poor adjustment) as 
evaluated by experienced clinical judgment: 
This finding of highly significant agreemen 
between results of assessment by these dif- 
ferent methods speaks for the validity of the 
Affect Questionnaire as an objective metho 
for investigating personality and apperception- 


Conclusions 


The over-all findings Suggest the following 
picture of an alienated young man: He is 4 
person whose apperceptions reveal relatively 
large amounts of egocentricity, distrust, pes 
simism, anxiety, and resentment in his per- 
sonality. His social apperception is distorte 
in that he apperceives other people in his €” 
vironment as being more alienated than they 
actually are. Although he sees others as alien- 
ated, he apperceives his contemporaries as Jesi 
alienated than himself, consequently less a 
erable than himself, And, finally, he feels tha 
his negative evaluations of the world and 
People are a far cry from the evaluations tha 
would be characteristic of any person he 
would regard as admirable or ideal. 

The testing of the above hypotheses has re- 
vealed that in our sample there are individu- 
als who see themselves as far from their ideals 
and considerably worse off, socially and psy 


| 


\ 
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chologically, than their contemporaries. This 
syndrome of alienation, shown to correlate 
with weak ego structure, which permeates 
their self-picture and distorts their appercep- 
tions of others, must certainly influence their 
Cognitive processes and their social relations. 
The Cognitive and behavioral consequences 
of this syndrome should provide fertile ground 
for future investigation. 


Summary 


The purpose of this study was to develop 
an objective instrument for measuring ap- 
Perception, and to test a series of hypothe- 
Ses concerning relations between personal 
apperception, social apperception, and ego 
Structure. Twenty Harvard undergraduates 
responded to a questionnaire containing 
evaluative statements representative of cer- 
tain critical dispositions of personality. Each 
Subject responded to these statements under 
the following conditions or sets: (a) his own 
Personal agreement or disagreement with 
them; (b) the degree of agreement he thinks 
Would be indicated by “the average Harvard 
student”; and (c) the degree of agreement he 
thinks would be indicated by an ideal person. 
tice tistical analyses of results on this ques- 
t nnaire led to formulation of a syndrome, 
ermed alienation, composed of the following 
ve interrelated dispositions: egocentricity, 
oousi, pessimism, anxiety, and resentment. 
a findings indicate that alienated subjects 
lone wolves” with grievances, distrust- 

7 of their fellowmen, apprehensive and 
Sloomy in their anticipations of the future. 
re Mpirical examination of five hypotheses 
ae that, in our sample, individuals who 
high on this syndrome tend to apperceive 
Sur č people in their social environment as 
al; e alienated than they really are, yet less 
lenated than themselves. Also, individuals 
ise, are high on alienation showed a greater 
or Tepancy between themselves and the ap- 
tee average person and between them- 
vidu: S and their ideal person than did indi- 
Was als who are low on alienation. Finally, it 
Worl found that individuals who view the 
d and their relationship to it in a nega- 


tive light have a weak ego structure as esti- 
mated by experienced clinical judgment. 
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Relationships Between the Rosenzweig P-F Study 
and Test Duration, Socioeconomic 
Status, and Religion’ 


Edward T. Parsons 


Pennsylvania State University 


This study had four aims: to correlate 
Rosenzweig Picture-Frustration Study scores 
with the time taken in answering it; to corre- 


late P-F scores with scores of the Sims Score 
Card for Socio. 


group and in ma- 
ions; to compare 
ting items of the 
of the total group, 


l -F items most often 
omitted and unscorable, 


The Ss were 150 
Pennsylvania high s 
plied a whole class, 


fashion. 


Sims scales Were administered first, then 
the P-F Study. The ti i 


answer the P-F 


ine i 
charge from E, T. Parsons, Children’s gea e hont 
ter, 335 S. Franklin St., ilkes-Barre, Pa or for a 
fee from the American Do i a ae 
obtain it from the latter, 
from ADI Auzilia 


duplication Service, Library of Congre: 


to Chief, Photoduplication Service, 
gress. 


Need persistence and intropunitiveness cor- 
related positively with test duration, both .24 
(p= .01). Extrapunitiveness correlated nega- 
tively with test duration, — .18 (p = .05). 

Socioeconomic status scores ranged from 2 
to 31, “lowest” to “highest,” according to 
Sims’ provisional levels. The mean was 17, 
“high.” No significant correlation was found 
between Socioeconomic status scores and P-F 
scores, 

Catholic/Protestant percentage ratios were 
27/73 and 75/25 in two classes, P-F mean 
Scores of these groups were compared to in- 
vestigate differences between Catholics and 
Protestants in minority and majority situa- 
tions. One difference was significant at the 
05 level, but chance would account for this 
since 28 differences were checked. Comparing 
P-F mean scores of all Catholics to scores of 
all Protestants gave no significant differences: 

P-F mean scores of the 13 Ss who omitted 
one or more P-F responses were compared to 
mean scores of the total sample. Those who 
omitted responses earned higher mean group 
conformity ratings. The difference was sig- 
nificant at the .05 level. 

The number of omitted and unscorable re- 
Sponses was less than 2% of all responses- 
Item 19 of the P-F study was most often 
omitted, and 69% of all omissions occurre! 
in the second twelve items. Unscorable re- 
sponses were found most often with items 14 
and 20, and 75% of the unscorable responses 
Were in the second half of the P-F study. 
Brief Report 
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Organizational Activity on the Rorschach Test 


1 


Boyd D. Sisson 
VA Hospital, Omaka, Nebraska 


and Earl S. Taulbee 
Norfolk State Hospital and University of Nebraska College of Medicine 


ae nization in Rorschach responses—de- 
ures ter “a as the combination of test fig- 
sponses 7 arger units that may be whole re- 
or the’ etails seen in relation to each other, 
filled-i combination of white spaces with 
evaluati elements—is widely used in the 
comm ion of test protocols. The meaning 
an feet, attached to this test activity is as 
of reg of intelligence or a component 
and igence, with the assumption of a direct 
sao ositive relationship between the amount 
hi [la and level of intelligence. The 
Tesea, re, however, contains relatively little 
i rch specific to the assumption involved 
zation rl interpretation of the organi- 
Some 0 Rn This paper will report briefly 
0 thi itherto unpublished findings pertinent 
nega It also will provide additional in- 
and Plat to a published study by Wilson 
Proble; ake (4) concerning a methodological 
n m in the organizational concept. 

test Baa study involving the Rorschach 
est ws the SRA Primary Mental Abilities 
aol ee a group of 32 “normal” high 
Coefficients Batt (1) reported correlation 
signin iS Of 49 and 46, both statistically 
Scor ant at the 1% level, between weighted 
ns a and the Verbal and Reasoning Por 
Preteg the PMA, respectively. He inter- 
late m, these findings as “indicating Z to T°- 
lecta St Closely to particular kinds of intel 
“apacit abilities, specifically those involving 
Words, A n understand ideas expressed in 
See and Dinar, logical problems, and to tore 
Ronee nother study Taulbee (3) used the 
ach to evaluate the intellectual levels 


tio; 


1 Fro 
m the VA Hospital, Omaha, Nebraska. 
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of functioning in a group of 60 hospitalized 
schizophrenic patients. He found the Z score 
to have a positive and significant relationship 
with the Full-Scale Wechsler IQ, but that the 
relationship in this group was due almost en- 
tirely to the correlation with three of the sub- 
tests—Digit Span, Similarities, and Vocabu- 
lary. It was concluded from these results that 
among schizophrenic patients the ability to 
organize and see things as a whole seems to 
be related to freedom from distractability, 
the ability to engage in verbal abstraction, 
and the ability for concept formation. 
Similarly, Wishner (5) previously reported 
Beck’s Z to be the most consistently signifi- 
cant of the Rorschach signs as an index of 
intellectual performance for a group of neu- 
rotic patients based on a correlation at the 
1% level of confidence between Z and the 
Full-Scale Wechsler IQ. These two studies 
show a consistency in significant correlations 
of W and Z with Vocabulary subtest scores, 
which offers support for the widely used clini- 
cal hypothesis that vocabulary test scores are 
relatively resistant to the effects of neurotic 
or schizophrenic processes and, therefore, pro- 
vide good estimates of premorbid intellectual 
functioning. 
Based on a group of 50 randomly selected 
psychiatric patients, Sisson and Yager ob- 
tained a correlation of .428 (p < .01) be- 
tween weighted Z score and Wechsler Full- 
Scale IQ; their data also yielded a correlation 
of .452 between unweighted number of Z re- 
sponses and Full-Scale IQ. Thus, it is seen 
that the above findings are in agreement in 
supporting the validity of the assumption that 
there is a positive relationship between or- 


30 Boyd D. Sisson and Earl S. Taulbee 
Table 1 
Relationship Between Weighted Z Responses and Number of Z Responses 
Mean Mean 
Age Mean weighted no. of r 
Group N range age z SD Z SD J 
5.36 982 
t 60 20-52 36.0 24.03 18.32 8.45 3 
Normal childven 70 8-18 13.4 23.22 19.40 7.71 5.31 = z 
Schizophrenics 60 20-39 27.6 27.38 17.30 9.08 5.17 “985 
Neurotics 35 20-46 31.9 26.87 19.59 9.57 6.14 “983 
Organics 10 19-44 32.8 27.50 15.11 8.90 4.01 s 


* Product-moment correlations between weighted Z scores and number of Z responses. 


ganization activit: 
intelligence. 

As pointed out b 
a second assumptio 


y on the Rorschach test and 


y Wilson and Blake (4), 


n involved in the organi- 
zational score aside from its operational va- 
lidity is the technique of scaling organization, 
study concerned with an 
weighting system used by 
ion with the various types of 


i Z score when number of 
Z responses is known, 


The following Study is re 
Pose of Providing addition, 


Wilson and Blake. 


Ported for the pur- 
al data to those of 


from a small midwestern community °? lo- 
cated in the same geographical locale from 
which the patients came. 

Table 1 gives a summary of the calcula- 
tions. Analysis of the data shows that em- 
Ploying the table of Wilson and Blake a 
best total weighted Z prediction when tota 
number of Z responses is known (which, bes 
a standard error of 4.74) correctly classifie 
the following percentage of cases within one 
and two standard errors, respectively: ae 
and 97% of the normal adults, 90% an 
99% of the normal children, 73% and 98% 
of the schizophrenics, 71% and 91% of the 
heurotics, and 90% and 100% of the organics- 


Discussion 


Results of the studies presented above sup” 
Port the assumption of a direct and positive 
relationship between organization activity oD 
the Rorschach test and intelligence, In this 
gs contribute to the 
validity of the or- 
is additional sugges 


telligence functioning: 
ting the areas of func- 
be least affected by the 
but it may also be help- 
theses as to the specific 
the ability—or inability 
ercepts, 

2 The records were fr 
der the Supervision of 


supported by the Univ 
Council, 


om a larger study done un- 
Dr. Marshall R. Jones a? 
ersity of Nebraska Researc 
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It is the writers’ opinion that the findings 
concerning the relationship between weighted 
Z scores and number of Z responses show that 
quantitatively the present system of scaling 
the Z responses for the purpose of enhancing 
the differentiating function of this activity is 
of little value. 

_ When the organization factor is used as a 

Single total as its contribution to interpreta- 
tion of the Rorschach test, the findings have 
Significance not only in questioning the value 
of the weighting system, but perhaps also in 
the interest of time saving and simplicity. It 
is recognized, however, that the use of Z in 
interpretation is not necessarily confined to 
Mere consideration of its total amount, but 
that it probably offers much more when also 
Utilized by analyzing its kind, distribution, or 
absence. In other words, the writers feel that 
the rationale for scaling Z according to the 
nature of the organizing activity involved has 
merit, and they certainly do not advocate 
abandoning it but believe that the above find- 
ngs show the necessity for further research 
în establishing a more sensitive method of 
Scaling. 


Summary 


: Results of several unpublished studies are 
“ported concerning the relationship between 
€ organization factor on the Rorschach test 


and intelligence level. In the main, they sup- 
port the clinical hypothesis of a direct and 
positive relationship, and also present evi- 
dence that the Z activity, at least among cer- 
tain groups, seems to be related most closely 
with certain of the verbal functions in the 
intelligence concept. 

Report is made of a study which yields 
very close agreement with earlier findings by 
Wilson and Blake of a consistent and ex- 
tremely strong relationship between simple 
summation of responses containing Z and 
total weighted Z scores. 


Received May 12, 1954. 
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Psychiatric Screening of Flying Personnel with the 
Cornell Word Form' 


Jobn R. Barry, 


for psychiatric scre 


dolph Air Force B 
of these cadets wa 
the basis of his t 

Three scoring 
tion. Subsequent 
Cross-validated wi 


est responses. 


criterion 


); cadets who com- 


checks payable to 
Library of Congress, 


Saul B. Sells, and David K. Trites 
Air Force School of Aviation Medicine, Randolph 


Field, Texas i 


tion of the resignees than of the other two 
groups was identified (p < 03). aa 
In a second study, criterion status W f 
based upon psychologists’ over-all ratings b: 
adjustment to flying training rather than fend 
training outcome alone. Cadets who failed a E 
who were given low ratings were assigned he 
the lower criterion group (N = 309). e 
upper criterion group (N = 392) inclu a 
cadets who were judged to have adjusted 
flying better than this lower criterion pet 
As was predicted, a significantly larger pr i 
portion of the lower than of the upper a 
terion group (11 and 7 per cent respective 
made three or more unhealthy test respons 
($ < 04), a 
In a third study, a stratified sample W 


selected to represent the total 
reference to the 


fail status. Ho 
used in the ¢ 


population with 
adjustment ratings and pee 
wever, only the ratings wer 
titerion. When these ratings 
were dichotomized at their mean, a signifi 
cantly larger proportion of those below than 
of those above the mean (13 and 4 per cen 


respectively) was identified by CWF re 
sponses (p < :02). 


responses to the CWF. a5 
these responses the cadets seem to expre 


4 ý á P 0r 
certain fears, dissatisfactions, and psych 
somatic symptoms. 
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Threshold for the Perception of Human Movement 
in Inkblots’ 


Frank Barron 


Institute of Personality Assessment and Research, 


s of the variables conceptualized and 
nostic ie part of the Rorschach Psychodiag- 
sae BY is the tendency of the subject to 
engaged human beings, or human-like animals, 
ii A bi in characteristically human activity 
tende ots (the M response). This response 
ward ncy is said to go along with a bent to- 
Tito introversion rather than extraversion. 
cet a has been variously defined; in 
A a it may be conceived of as a tendency 
a ae thought rather than action, to ex- 
than ce vicariously and in fantasy rather 
throy “4 real life and directly, and to create 
en gh the arrangement of symbols rather 
which through the arrangement of objects 

Th Stand for nothing but themselves. 
stud e aim of the present investigation was to 
Fae the personality correlates of the human 
ieee response tendency in a research 
ain tion which would make it possible to ob- 
ptt ad Pendent evidence concerning the per- 
Provided of the subjects. Such a situation is 
with ie by the living-in assessment method, 
jects tt emphasis upon observation of the sub- 
inte rough several days of informal social 
. “taction, lifelike situational tests, group 


iscusc y 
he improvisations, group games, an 
ike. This makes it possible to discover 
1 Th; 
Statai Pesearch is supported in part by the United 
monitored Force under Contract No. AF 18 (600)-8, 
(Officer H by Technical Director, Detachment No. 
Tsonnel ducation Research Laboratory), Air Force 
ir For and Training Research Center, Maxwell 
Teproducti Base, Alabama. Permission is granted for 
~cton, translation, publication, use, and dis- 
in whole and in part by oF for the United 
Overnment. Personal views or opinions €x- 
or implied in this publication are not to be 
D as necessarily carrying the official sanction 
search epartment of the Air Force or of the Air 
and Development Command. 
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University of California, Berkeley 


how persons who have much or little readi- 
ness to perceive human movement in inkblots 
are described by skilled psychological ob- 
servers who become acquainted with them but 
not with their test scores. 


The measure of readiness to perceive human move- 
ment in inkblots was especially constructed for this 
study, and represents an attempt to supplement the 
Rorschach test itself as an instrument of observation 
when Rorschach theory is in question. As users of 
the test know, the Psychodiagnostic is very com- 
plex, both stimulus-wise and in its scoring scheme, 
and it does not lend itself well to any attempt to 
isolate variables and to separate out their correla- 
tional components. While this complexity is impor- 
tant to the test as a vehicle for clinical observation, 
it contributes to certain psychometric shortcomings 
and unnecessary difficulties when the verification of 
theory is the chief concern. 

One important difficulty with the scoring scheme 
is that the number of responses varies widely for dif- 
ferent subjects. Productivity is itself an important 
variable, of course, but the present method of ob- 
taining a measure of it tends to confound the evalua- 
tion of other measures which may be equally impor- 
tant. Subjects now cannot be compared in terms of 
absolute incidence of a given type of response, since 
this is partly a function of total number of responses. 
Furthermore, subjects cannot be compared in terms 
of relative incidence, for relative incidence of re- 
sponse in a given category varies in some nonlinear 
and as yet undetermined fashion with total number 
of responses. This in turn is dependent to some ex- 
tent on stimulus properties of the blots; there is 
clearly a limitation to the number of responses which 
can be given in any single category, and after a cer- 
tain point in the production of responses the more 
limited categories begin to suffer relative to the 
others. 

What is needed, then, is a method of keeping the 
number of responses more or less constant for all 
subjects, while yet providing considerable opportu- 
nity for the subject’s response tendencies to emerge. 
At the same time, stimulus strength should be 
weighted properly jn evaluating response strength; 
one difficulty with the Rorschach measure of M tend- 
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ency is that it is a simple count of the number of 
human movement percepts which are verbalized by 
the subject, without regard for the power of the 
stimulus to evoke 2 human movement response in 
the average person. y 
Some of the difficulties may be met if these pre- 
scriptions are followed: (a) increase the number of 
blots; (b) score only one response, the first, to each 
blot; (c) take systematic account of the relationship 
between stimulus strength and response tendency by 
employing the conventional experimental index of 
this relationship, response threshold; (d) isolate the 
main Rorschach variables and study them one at a 
time before attempting to study them all together. 
The rationale of these Prescriptions jis simple and 
clear. An increase in the number of blots should 
achieve more representativeness on the stimulus side 
and more total-score reliability (since reliability may 
be increased, up to a point, by increasing test 
length). Scoring of only one response to each blot 
makes the absolute number of responses in each 
i subject to subject, 
e sort of standard 
so that the individual sub- 
be immediately referred to 
i al population? The weighting of 


weights in Prediction; 
of threshold makes th 


which is all to 


c ry is concerned, 
variables in isolation, however 


> n m, may really be the best pos- 
sible foundation for e understanding of variables 


Construction of the Measure of Threshold 
The model for the construction of' 
Bi > 
ure of threshold for perception of een 


Pointed out incidental 
schach ratios, such as M:Su tally that Ror- 


Sum C, ma; be 
meaningful if they are ratios of 7 -2 Pe much more 
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movement is the conventional stimulus series 
used to determine response thresholds in such 
sense modalities as the auditory, olfactory, 
tactile, and the like. Although stimulus strength 
or intensity is not determinable from physical 
Properties of the stimulus in the case of ink- 
blots, this is no great loss so long as relative 
frequencies of response can be established in 
large samples and with some stability. By 
arranging inkblots of known relative fre- 
quency in a regularly graduated series, with $ 
values ranging from .00 to 1.00, a measure 
analogous to the usual perceptual stimulus 
series is constructed. The subject’s threshold 
for human movement is then the ordinal posl- 
tion of that blot in the series at which he first 
gives a human movement response. 

This ideal design was not carried out ex- 
actly as projected in the present study, 
largely because of time pressures in the sched- 
uling of the assessments. One hundred and 
fifty achromatic inkblots had been constructed, 
using 4- by 6-inch sheets of white paper, which 
were then mounted on stiff cardboard of the 
same dimensions. The plan had been to select 
26 blots from the 150, on the basis of ob- 
served frequencies, in such a manner as to 
make a series with graduations of approxi- 
mately .04. It became necessary, however, to 
select the blots on the basis of observations 
in a small Preliminary sample, and to order 
them initially in terms of observed frequencies 
in that sample. For this reason, the threshold 
score finally assigned to the assessed subjects 
was based on the relative frequency of M 
response to each blot in the assessed sample 
itself. This design is somewhat inferior to 
what was first intended, but it still fills the 
Prescriptions specified for construction of a 
measure which would Overcome some of the 


difficulties inherent in the Rorschach measure 
of M tendency, 


As it turned out, 
zation yielded a f 
The rank-diff 
order of 


, the preliminary standard- 
airly stable stimulus series- 


quencies observed in 
85. The Stability of ¢ 
lots in the rath 
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ence correlation between a rank order based 
eo frequencies in the first 50 cases 
a rank order based on observed fre- 
a in the final 50 cases: rho is .99. 
om is homogeneous sample, the M-evoca- 
sai of inkblots is remarkably stable. 
Sl pars range of scores for individual 
bf 27 i is, of course, from 1 to 27 (the score 
aa eing assigned to subjects who do not 
pected m any one of the 26 blots). The ex- 
a range, considering the method of con- 
ited ak the measure, is from 2 (since no 
he or ould see M on the first blot) to 26. 
with th ual observed range was from 2 to 25, 
ia Sie at 13. The form of the distribu- 
approximately rectangular. 


The Sample and the Method of Study 


in ie Fleas in this study were 100 captains 
above ay S. Air Force. As a group they were 
Blin)’ . in intelligence, in education, 1n 
age ran health, and in personal stability. The 
of 33 All was from 27 to 50, with a mean age 

ree l of the subjects were men. All but 
east E married, and most of them had at 
ack tie children. In pre-army socioeconomic 
c ee they tended to be lower middle 
at 3 he majority of these officers were com- 
a and many of them had been 
abilit ed for valor in World War II. In most 
age, Ae alan they scored well above aver 
8eneral, were less variable than men-m- 

oe aa jects were seen in groups of ten for 
Method , days at the Institute house. The 
Upon ae study placed considerable emphasis 
Social į servation of the subjects in informal 
Cholo interaction, The assessment staff psy- 
jects gists sat down to meals with the sub- 
a » took part in a social hour before dinner, 
m general were participant observers 
nt. a t the three days of living-in assess- 
cussions uational tests, interviews, grouP a 
like were improvisations, charades, and the 
` ee ee in the assessment program, 
Jects had e social characteristics of the sub- 
Selyeg o nuch opportunity to manifest them- 
etve ; is nd the raters were in a position to ob- 

Significant behavior. 


thro 


Observations made by staff members during the 
three days of study were condensed and rendered 
easily susceptible of statistical analysis chiefly 
through two techniques: a set of 76 statements de- 
scriptive of personal functioning and permitting the 
expression of clinical inferences, and an adjective 
check list (3) consisting of common, personally de- 
scriptive adjectives. Both techniques were used by 
staff members at the conclusion of the three days 
of assessment to sum up their impressions of each 
subject. 

The 76 statements were sorted on a 9-point scale 
(a so-called Q sort), the frequencies at each point 
being such as to make the final distribution conform 
closely to the normal curve. The 300 adjectives 
were checked simply as characteristic or not charac- 
teristic of the given subject. The Q-sort composite 
was obtained by averaging the placements of the 
items by four staff members, and then redistributing 
these averaged values on a normal curve. The ad- 
jective composite consisted of all adjectives which 
had been checked as characteristic of a subject by 
three or more raters. A 

These descriptions and ratings were of course given 
without knowledge of the objective test perform- 
ances of the subjects. No rater knew the M thresh- 


old of any of the subjects at the time the ratings 


were made. aP: 4 
In addition to these descriptions based on soci 


observation of the subjects, information is available 
concerning life-history factors. Each subject was 
interviewed for two hours by a psychiatrist or clini- 
cal psychologist 
in the assessment), 


was used to summarize impressi 1 f 
ife-history check list contained sections 


i e li 
pe te do with the subject’s recollection of him- 
self as a child, his imagery of his parents, his fa- 
vorite games, his playmates, and so on. 

Finally, certain objective test measures were ob- 


tained on all subjects. These included measures of 
general intelligence, of originality, of personal sta- 
bility, and of social attitudes. Scores from all of 
them were available for correlation with M threshold. 


Correlates of M Threshold 


e remembered, of course, that 
he threshold measure are 
those with less readiness to perceive human 
movement; lower threshold means greater 
disposition to give an M response. — s 
The observer adjective descriptions which 
are significantly (.05 level) related to thresh- 
old for M when the first quartile of the dis- 
tribution (threshold scores from 2 to 8) is 
ith the fourth quartile (threshold 


compared w! 
scores from 18 to 25) are as follows: 


It should b 
high scorers on t 
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Early M response (low threshold) 
intelligent 
fair-minded 
mild 
anxious 
mannerly 
inventive 
interests wide 


Late M response (high threshold) 
practical 
stubborn 
simple 
masculine 
arrogant 


The composite Q-sort descriptions yielded 
the following items with significant (.05 
level) differences between the groups: 


Early M response (low threshold) 
1. Highly cathects intellectual activity; values cog- 
nitive pursuits. 
2. Gets along well in the worl 
appropriate in his behavior, 
3. Is introspective; Concerned with 
ject; frequently self-aware. 
Has high degree of intellectual ability. 


Id as it is; is socially 


his self as ob- 


Late M response (high threshold) 
. Has narrow range of interests. 


Allows Personal bias, spite, or dogmatism to enter 
into his judgment of issues. 
3. Prefers action to contemplation. 

4. Is rigid; inflexible in thought and action. 


At this Point, an important discre 
tween observers’ descri 


lem solving 
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constructed by Gough (4) was also employed. 
Several tests from the Guilford Creativity bat- 
tery (6), including the Unusual Uses, Pa 
Titles, Consequences, Match Problems, Gesta t 
Transformation, and Controlled Association 
tests, were used; none showed a significant 
relationship to M threshold. The failure to 
find such relationships occurred both when 
M threshold was correlated with these meas- 
ures for the entire 100 cases, and also vn 
the first quartile on M was compared wit 

the fourth quartile. 

What these facts plainly say is that sub- 
jects with greater readiness to perceive M ap- 
pear to psychological observers to be more 
intelligent, more inventive, and broader m 
their interests in social situations, but that in 
controlled testing situations, when problem- 
solving activity is called for, M threshold is 
unrelated to test scores. If we assume the 
validity of the test measures, the most direct 
explanation of ‘the discrepant adjective and 
Q-sort descriptions would seem to be that 
Psychologists falsely attribute greater intel- 
ligence to persons who manifest more tendency 
to introspect, to take thought rather than to 
take action. A check on this hypothesis seems 
to support it: the Q-sort item “Has a high de- 
gree of intellectual ability” correlates .45 with 
the item “is introspective; concerned with his 
self as object; frequently self-aware.” The 
latter item, however, correlates only .11 with 
the Arthur Stencil Design Test, .02 with the 
Idea Classification Test, .26 with the Wesman 
Personnel Classification Test, and .27 with 
the Terman Concept Mastery Test. Intro- 
Spection thus appears to be weighted unduly 
by the Psychological staff in judging intel- 
ligence. Perhaps, after all, the more “thought- 
ful” person is not alw. 


g 
person, thoughtfulnes i i 


© concerning developmental factors re- 
lated to AL tendency is furnished by the life-history 
interview material. The subjects with low thresh- 
themselves significantly (0. 


ir chine often as quiet and self-conscious during 
their childhoods, Th 


€y were also less interested iñ 
Sports, And took Less bart in rough-and-tumble play, 
subjects; the latter more often 
J es as having been active, ani 
characterized their childhood as happy. , 
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Lethe some possibly related differences be- 
Hone of ch wo groups of subjects in their descrip- 
fesenece sc eir mothers: the adjectives showing dif- 
letting significant at the 05 level are nervous, pro- 
ae i sgeaseratiae, punishing, and worrying, all of 
low-thresho} more characteristic of the mothers of 
toti the ie subjects. The general picture we get 
Bim ek i e-history interview material is that the 
buman the in adulthood has more disposition to see 
soteska, yn in the inkblots was in childhood 
maternal] A sensitive, and overprotected, or even 
interact p bag meget In relation to this, it is of 
Psycholo hat the Femininity key of the California 

hie om Inventory (5) correlates — .26 with 
ing high old (the more M-disposed subjects obtain- 

gher femininity scores). 


in cee readiness to see human movement 
spectiven blots seems to go along with intro- 
Guiggesting’ thoughtfulness, fair-mindedness 
Cognitiy ing ethical discrimination based on 
the intel principles), and @ high valuation of 
a certaj ectual processes, based perhaps upon 
Course 2 inhibition of activity and greater re- 
are ten fantasy in childhood. Such persons 
mannerly in adulthood as relatively mild, 
e m and even anxious as compared with 
who ha ical, masculine, and simple individuals 
the biot less tendency to see movement 1m 
of M a It appears too that an extreme lack 
the Q. ndency may at times be nonadaptive: 
Sort items “is rigid; inflexible in thought 

or aon” and “allows personal bias, spite, 
T ara to enter into his judgment of 
which point clearly to the kinds of liabilities 
titude accompany the static perceptual at- 
Stubbs his is seen as issuing on occasion 1n 

ornness and arrogance. 


Discussion 


are tschach’s claim that movement responses 
ki Uncti uced most abundantly by persons who 
Ose more in the intellectual spheres 
intraps nterests gravitate more towards their 
Worl, ychic living rather than towards the 
i Sén ba themselves” (7, p. 64), seems 
4 ~ to be supported by these findings. 
relate nse, the fact that M threshold is un- 
rather ae measured intelligence strengthens 
Btoups <a weakens this conclusion. If two 
but o of subjects are equal in intelligence, 
her group is characteristically described 
Cemed a Benf, more introspective, more 

iv to with intellectual activity, and more 
contemplation than to action, then it 


seems fair to say that these latter individuals 
function more” (not necessarily better) in 
the “intellectual sphere.” 

Rorschach himself, of course, thought of 
this tendency as “a component of intelligence” 
(7, p. 63). The production of many move- 
ment responses is, he claims, one of the char- 
acteristics of “intelligent subjects.” Since this 
observation was based upon his own estimates 
of his subjects’ intelligence, it may be that he 
was misled by the same occupational prejudice 
displayed by the psychologists of the staff of 
this Institute. (Rorschach was not above in- 
jecting his own biases rather freely into his 
experimental observations, as witness his en- 
tertaining preoccupation with “pedants” and 
“grumblers,” two diagnostic categories which 
appear more frequently in the Psychodiag- 
nostic than would seem warranted by ordi- 
nary nosological usage.) 

In some ways, it seems preferable, from a 

sychological assessment standpoint, to have 
a well-defined and measurable variable which 
is entirely stylistic in character and free of 
correlation with measures of general ability. 
Where style is important in effectiveness of 
performance, such variables may add more to 
a prediction equation than do variables which 
are loaded with intelligence factors. This is 
especially true where personal interaction is 
concerned, and where certain combinations of 
styles of performance work better than others. 
Two-person situations with subjects selected 
especially for similarities or differences of 
style offer interesting possibilities for tests of 
hypotheses concerning the conditions which 
make for constructive and empathic interac- 
tion versus those which make for destructive, 
stultifying relationships. Rorschach suggests, 
for example, that a person with strong intro- 
versive tendencies can hardly be understood 
at all by a person whose bent is strongly ex- 
tratensive; with adequate measures of such 
tendencies in perception, experimental verifica- 
tion of such a hypothesis would not be dif- 
ficult. 

The present measure of M threshold is as 
yet ina preliminary stage of development. It 
is evident that Guttman scale analysis is made 
to order for the psychometric goal of accurate 
placement of an individual in relation to 
others on such a dimension as M tendency. 
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It seems quite possible that other Rorschach 
factors could be equally well measured, and 
that a series of separate tests could be pro- 
duced which would be much better, from 
the point of view of perception theory and 
research, than the instrument with which 
Rorschach made his initial observations. He 
himself, of course, was quite open to such in- 
novations, and indeed suggested a number of 
interesting possibilities in his classical mono- 
graph. 


Summary 


A measure of threshold for the human 
movement response was constructed by ar- 
ranging inkblots of known M-evocative power 
in a regularly graduated series. The final 
series consisted of 26 blots, selected from a 
group of 150 blots for which the relative fre- 
quency of M response was known. The sub- 
ject’s threshold score, based on the final ar- 
rangement of the 26 blots, was given by the 
ordinal position of that blot in the series at 
which he first verbalized a human movement 
response. 

The correlates of M threshold were studied 
in a sample of 100 military officers who took 
part in three days of livin 
who had been described 
through the use of Q 
list techniques. The 


Frank Barron 


sidered by staff psychologists to be more in- 
telligent, inventive, introspective, contempla- 
tive, and the like. The conclusion was that 
the human movement tendency is a stylistic 
variable, and that it does indeed relate, as 
Rorschach thought it did, to a preference for 
“intrapsychic living” as opposed to interest in 


action, practical affairs, and “the world out- 
side.” 


Received May 20, 1954. 
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Sealing to define the nature and extent of 
tion S which occur as a result of the opera- 
signifi prefrontal lobotomy revealed certam 
a ay changes in lobotomized chronic 
terval’ renics following a three-month in- 
measu. (2, 3). These changes were mM part 
ah PRES by scores on 11 factors based on 
in judgments made on an extensive rat- 

& schedule (4, 7). 

Subsequently, the correlations between the 
alti factor scores of 153 of the 
matches selected for lobotomy and their 

a ed controls were factor analyzed (5). 
eee was undertaken in the hope of 
SUN A more satisfactory conceptual dif- 
esses Prt of the major schizophrenic proc- 
Ond-9 da is presently available. Three “sec- 
to the er” factors were identified and related 

hia reported in previous studies. Factor 
of a Was interpreted as a bipolar parameter 
ee withdrawal with motor disturb- 
Was r versus an agitated excitement. Beta 
isor egarded as a factor of distortion an 
ce cote in thinking and perception. 
Was a described a fighting reaction which 
pages belligerence. 
sented Scaled clinical judgments as repre- 
ere in the 11 factor scores indicated that 
izeq AP favorable change in both lobotom- 
month control groups at the end of a three- 

e eae However, the degree of favor- 
Operat ange was significantly greater for the 

ed patients on certain of the factor 


scores. A number of questions arose as to the 
nature of the changes in the operated pa- 
tients and their controls. Can change best be 
described in terms of a single general factor 
of reduced pathology or in terms of several 
group factors? If change can be described in 
terms of several factors, are these the same 
as those originally identified in the analysis of 
the preoperative scores? Furthermore, are the 
change factors the same in the operated and 
nonoperated groups? If they are similar, then 
the findings of greater change in the operated 
patients would suggest that lobotomy simply 
quickens or stimulates the normal process of 
recovery. Isolation of different factors in the 
two groups would imply the development of 
new patterns or the production of adverse ef- 
fects or compensatory defects. 

In order to throw light on these questions 
two parallel factor analyses were undertaken, 
one of changes in lobotomized patients, and 
one of changes in control patients. The vari- 
ables used were the changes in 11 factor 
scores obtained over a three-month interval. 


Procedure 


The patients were 250 chronic male schizo- 
phrenics at six Veterans Administration hos- 
pitals. They had been ill for a period of four 


mized and 125 we 
serve as controls. 
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The data consisted of clinical judgments 
recorded on a schedule of 81 brief descriptive 
rating scales (7). The interview section of the 
schedule consisted of 46 scales which were 
completed following a one-hour diagnostic in- 
terview by a psychiatrist or psychologist. The 
ward section consisted of 35 scales filled out 
by a psychologist upon the basis of informa- 
tion secured by interviewing nurses or at- 
tendants who knew the patient well. The 
schedule itself was designed to record in rela- 
tively objective form characteristic behavior 
and symptoms observable in an interview or 
on a hospital ward as well as certain items 
descriptive of hospital adjustment. 

Initial ratings were obtained prior to the 
operation on patients later lobotomized and 
on patients selected to serve as controls. 
Three months following the initial descrip- 


tion the same patients were again interviewed 
and rated. 


The 11 initial and three 


tive scores computed for each patient were 
based on 11 factors Previously identified in a 
multiple-factor analysis of the tating schedule 


of the sum of the 


-month postopera- 
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The 11 factors scored may be identified by 
the name and letter that follows: 


A Retarded depression versus manic excitement 

B Compliance versus resistiveness 

C Paranoid projection 

D Activity level 

E Melancholy agitation 

F Perceptual distortion 

G Motor disturbances 

H Submissiveness versus belligerence p 

I Aggressive social activity versus social with- 
drawal 

J Self-depreciation versus grandiose expansiveness 

K Conceptual disorganization 


Each patient’s change score, based upon the 
difference between his initial and his three- 
month postoperative factor score, constituted 
the basic data for our analysis. Pearson cor- 
relations were computed separately between the 
11 factor change scores of the 125 lobotomized 
patients and the 125 controls, 


The 11 x 11 correlation matrix of the op- 
erated patients’ change scores was factored 
by the centroid Procedure with the highest 
correlation coefficient in the column utilized 
as the communality estimate. The communal- 
ities obtained were reinserted in the matrix 
which was again factored. The mean ab- 
solute fourth factor residual was then .04 as 
compared with the standard error of .064 of 
a zero correlation coefficient, 

The correlation matrix of the control pa- 
tients’ change Scores was factored with cen- 
troid estimates of the communalities in the 


d 125 Nonoperated Schizophrenics 
ents above diagonal; matrix for controls below diagonal.) 
Factor 
scores A B Cc 
D F G H 
I 7 K 
A 01 08 
4 a 27 55 06 15 07 =- 
= G e 38 26 —04 43 41 26 i 37 E 
D 2 S m 29 13 5 4% 53 05 25 43 
Z a iy A Ta 32 33 25 27 -09 23 19 
F ei i k 07 14 2 -12 13 07 
A i an En 08 ~06 27 43 02 1 
H 26 33 21 a T H “n 36 at 3 
; E o ie 04 15 13 29 = 3i 
J 21 18 29 = i E a 02 i 
+ Se —03 21 29 
= a l 2 5 og (83 ma | 
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Table 2 
Centroid Factor Matrices Fe (Operated Group) and Fe (Control Group) 


Factor Be Fe 
Scores I n I IV WwW I rt wm vV #j 
A 40 —67 19 03 5 
4 = 65 42 —37 11 2 4l 
z 54 29 + —09 16 41 19 15 43 —33° 35 
2 62 18 —25 5 St 49 2 11 ft 82 
z 49 —15 —07 17 30 24 —38 —38 10 36 
E 39  —54 22 os 50 16 —33 14 36 28 
a 62 2 —24 12 50 60 47 -4 16 66 
A 60 36 44 i4 70 67 40 16 13 65 
; 69 18 —-12 —34 64 55 —23 37 —26) 156 
p —10 43 37 233 38 —11 38 34 25 33 
Z 62 20 12 —30 53 50 —07 i5 =o 2 
60 39 11 i 55 49 53 —21 —10 58 
Sum of 
Squares 3.20 1.47 59 41 5.67 215 1.33 78 .57 4.82 


pean. Four factors were again found to 

residu ‘mon The mean absolute fourth factor 

in Tabi was .03. The two matrices are shown 

the obj e 1. The rotations were oblique with 
ject of attaining simple structure. 


Results 


ia centroid factor matrices Fo and Fe for 
able a and control groups are shown in 
factor m To facilitate comparisons the rotated 
feather ee Vo and V, are also presented 

gether in Table 4. 
Me t for factor Z the first centroid is 
E Sa particularly prominent for the 
actor ee group. Implied here is 4 general 
duced of “improvement” in the sense of re- 
impro pathology. When schizophrenic patients 
ile they tend to improve In all areas. 
Mean presents the mean preoperative and 
te es factor scores for the two 
Tection The changes are neatly all in the di- 
ant “aa less severe symptoms and less devi- 
e o avior. The increase in mean score for 
I set patients on factor 4, retarded 
movement „versus manic excitement, implies 
sive rage, the direction of reduced depres- 
is ae the mean A score of the controls 
creases. $ ly unchanged, the median score in- 
ager, Tom 20.9 to 21.6. However, the factor 
draw. e social interest versus social with- 
al (Z) shows no change for the control 


group either in central tendency or in the 
shape of the distribution. 

The first factor Ao in Table 2 of the op- 
erated group is characterized by motor dis- 
turbances (G), withdrawal (Z), and con- 
ceptual disorganization (K). Reduction in 
this factor appears to relate to reduction in 
tendencies toward a catatonic-like withdrawal. 

The Ae factor of the control group is de- 
fined by withdrawal (Z), motor disturbances 
(G), and a negative projection from overac- 


Table 3 


Preoperative and Postoperative Mean Factor 
Scores of 125 Lobotomized and 125 
Control Schizophrenics 


Lobotomized group Control group 
Pre- Post- Pre- Post- 

Factor operative operative operative operative 
scores mean mean mean mean 
A 21.1 22.6 21.7 21.4 
B 7.4 5.9 6.3 6.1 
c 12.1 9.5 11.2 10.6 
D 12.8 12.4 12.3 12.1 
E 20.7 20.0 20.4 20.2 
F 12.1 10.0 14.3 10.4 
G 18.1 15.4 17.1 16.1 
H 11.9 98 10.6 10.1 
I 18.5 17.1 17.8 17.6 
f 14.7 13.5 13.8 12.8 
K 21.2 18.9 20.8 19.1 
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Table 4 


Rotated Oblique Factor Matrices 
Vo (Operated Group) and V, (Control Group) 


Vo Ve 
De 
Factor ais Bo Gs D, i’, B. C E 
6 
i i A - 71 —06 04 —03 49 0 
pega 2 15 —01 41 01 27 =02 z% a 
emee ae ee oe agt -1 
tivit, =| i E 
INA E 08 66 01  —03 07 = rol E 
Perceptual distortion F 00  —03 50 03 02 i sa 26 
Motor disturbances G 64 24 09 17 28 4 R 65 
Belligerence H —05 —04 14 49 02 20 i -o4 
Withdrawal I 53 —07 —07 —08 55 26 A 45 
Grandiose expansiveness J 17 06 —01 49 —05 11 
Conceptual disorganization K 37 05 


tivity (D). Represented here, then, is a re- 
duction of withdrawal behavior and an in- 
crease in motor activity. If A, and A, may be 
, this would sug- 


c appear to represent 
schizophrenic excitement, Factor B, is defined 
i melancholy agitation 
d primarily by excite- 
or disturbances, These 
a reduction in schizo- 
gain, if we assume that 
c represent the same process, then 


ent in control cases is 
more clearly associated with diminution in 


is characterized primarily by 
paranoid projection (C), perceptual distortion 
(F), resistiveness (B), overactivity (D), and 
conceptual disorganization K). Cy is also de- 
fined by perceptual distortion (F), Paranoid 
Projection (C ), and conceptual disorganization 
(K). However, the Projection of conceptual 
disorganization js substantially larger: and 
motor disturbances (G) is also Prominent, 
Factor C, may represent a reduction in Para- 
noid projection. Factor G, 


c Seems to involve a 
more general reduction in disorganization and 


distortion of perception, thinking, and motor 
activity than C,. a 
Factor D, appears to represent a grand 
belligerence. In the operated group, this facto’ 
is defined by submissiveness versus beliger 
ence (H) and self-depreciation versus ki 
diose expansiveness (J). Factor D, has in a 1 
dition a reduced resistiveness (B). In conti 
patients, therefore, the reduction in belliger- 
ence includes a shift in the direction of co 
operation. N 
Table 5 presents the direction cosines be 
tween the reference vectors in the two analy- 
ses. Both matrices sugġest two more gener: 
groupings, However, as a minimum of fivé 
variables is required to isolate two factors, 
the correlations between the primaries wea 
not computed or factored. For the operate 
group paranoid distortion Co and grandiose 
belligerence D, jointly improve and represent 


a reduction in the fighting reaction and in 


Table 5 


Direction Cosines Between Reference Vectors 
(Cosines for Vo above diagonal; cosines 
for V, below diagonal.) 


Factor A B c Z 
Withdrawal A 100 153 06 ae 
Schizophrenic excitement B38 1.00 .25 me 
T inking disorganization C —.24 —0g3 1.00 —.1 
Grandiose belligerence 


D —01 —19 — 64 
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Paranoid reality distortion. In the control 
group reduction in catatonic-like withdrawal 
(A.) and reduction in schizophrenic excite- 
ment (Be) are negatively associated. 
fi It is also of some interest to relate the 
actors here identified to those found in previ- 
nS studies. A factor analysis of the correla- 
— between the 11 preoperative factor 
ores of 153 of the patients included in the 
ae study resulted in the identification of 
i second-order factors, Alpha, Beta, and 
Al gs described earlier in this report (5). 
S T was interpreted as a bipolar factor of 
Sh etic withdrawal with motor disturbances 
a Sus excited agitation. Alpha appears to be 
ceed by two change factors. It is the 
lik ors’ hypothesis that reduction in catatonic- 
oe withdrawal resulted in factors Ao and Ae. 
p c Uction in excited agitation resulted in the 
ce factors B, and Be. 
ide eta of the preoperative analysis (5), X 
Ntified by Degan (1), and BB identified 
ie Tom, Jenkins, and O'Connor (6) are simi- 
Be the factors of disorganization and dis- 
‘act a in thinking and perception Co and Ce 
of i Do and D. (grandiose belligerence) 
z e present study correspond closely to 
mma and identify a fighting reaction. 


Summary 


of ny study was undertaken for the purpose 
resulting ing light on the nature of changes 
a SR from prefrontal lobotomy and routine 
tients, care on chronic schizophrenic pa- 
(a) th Questions were raised as to whether 
interval favorable changes occurring over an 
orb al of three months could be accounted 
result One factor or several; (b) the changes 
Were ae from lobotomy and hospital care 
Ors raw or different; (c) the change fac- 
from aaa ed were similar to or different 
Popul hose originally isolated in the same 
ation sample. 
in 125 po relations between 11 change scores 
125 obotomized schizophrenic patients an 
control schizophrenic patients were in- 


dependently factored. The change scores were 
obtained on the basis of preoperative and 
three-month postoperative ratings on a fac- 
tored set of 81 rating scales. 

Four closely similar factors of change were 
identified in the two analyses. The schizo- 
phrenic processes tentatively identifed were 
reduced social withdrawal with motor dis- 
turbances, reduced schizophrenic excitement, 
reduced grandiose belligerence, and reduced 
disorganization and distortion of thinking. 
These findings strongly suggest that although 
lobotomy results in the improvement of many 
patients with chronic schizophrenia, the na- 
ture of the process of improvement in schizo- 
phrenia following lobotomy does not differ 
greatly from that which may occur without 
lobotomy. Two of the: four factors correspond 
closely to factors identified in the preopera- 
tive study. The other two change factors ap- 
pear to have emerged out of a third preop- 


erative bipolar factor. 
Received June 2, 1954. 
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Rorschach Determinant Shift Among Hallucinatory 
and Delusional Patients’ 
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Several studies have shown 


schach test Ch, (2.3), 


In one st 
found to sh 


í significantly 
ance in Psychotherapy, 


In view of thes i 


1 From VA Hospitals, Brockton, Ma: 
Marion, Indiana, ‘ vai, = Sa 


? Personal communication from Mr. L. Salk. 


Indiana and Brockton, Massachusetts 


; «ation 
and deserved further experimental applicatio" 


This study is another attempt to apply 
measure, 


Design 


Two groups of patients were chosen a 
this study. The criteria for including a E 
ject in either group were that he be a ki ) 
male World War IT veteran, have a total 
of 
no central nervous system involvement, ar 
Present definite hallucinatory or delusion $ 
symptomatology. The Rorschach was adma 
istered to each subject at the time that K, 
hallucinations or delusions were being over 
manifested. In one group were 30 pac m 
who reported definite hallucinations in ad 
tion to other symptoms. In the second grouf 
Were 30 patients for whom there was clea 


evidence of the Presence of a definite delt” 
sional system, 


Yy one 


liability 
as a scorer had bee, pon? whose relia 


een established in the previ- 


80 or more on the Wechsler-Bellevue, show } 
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Results 


„The two groups were first compared for 
differences on total Rorschach responses by 
the conventional method of scoring determi- 
nants, which utilizes verbalizations on both 
free association and inquiry. All comparisons 
were made for the raw scores and also for 
the percentage scores for each determinant 
converted into arc-sine units. This has been 
described in previous studies (1, 2, 3). The 
results are summarized in Table 1. 

Since there is no difference for the total 
number of responses, it is possible to com- 
pare the groups directly on determinants. Pa- 
tients with hallucinations give significantly 
more human movement (JZ) responses, while 
patients with delusions show significantly 
more form-dominated color (FC) responses 
and more responses with color as a determi- 
oe (Total C, including FC, CF, and pure 

On the free association hallucinated pa- 
tients give significantly more M and V re- 
sponses. No significant differences between 
the groups are found for the other determi- 
nants. Since the frequencies for both V and 
M are too small for the differences tO be 
meaningful, the two groups may be consid- 
ered not to differ significantly on free asso- 
ciation. 

When the two groups are compared on de- 


Table 1 
ents 


Comparison of Hallucinating and Deluded Pati 
for Rorschach Determinants 


Mean 
RG srt arc-sine crt 
Variable Hal. Del. CRt differences 
F 2.5 
f 147 136 oun 2a age 
FC : 4 1 1:3" —6.1 2.3 
Z i i Er K 
5 13: 3 
TotalC 2 = 


7 

4 

4 
3.5 1.6f 
1.5 

3 

1 


* Significant at the -05 level- 


** Significant at the -01 Tovey’ 

Significant at the 10 level: re significant at t 
Only critical ratio 

or below are reported. 


he .10 level 


Table 2 
Comparison of Hallucinating and Deluded Patients 
for Rorschach Determinant Shift 
Mean shift Mean 
arc-sine 
Variable Hal. Del CRt differences CRt 
F 2.2 3.3 1.6¢ —6.4 23 
M 4! 6.5** * 
FC 6 14 B.5F —4.0 1.9} 
CF A 7 - 9 
Cc B 
TotalC 10 20 3.4* —4.0 19t 
FY 7 10 —5.7 21% 
Y+YF 3 „1 1.7t + 9 
Vv 0 A sa —1.1 
Total ¥ 1.0 1.3 -5.9 2:5? 
so 


* Significant at the .0S level. 
** Significant at the .01 level. 

+ Significant at the .10 level. -a 

t Only critical ratios which are significant at the .10 level 


or below are reported. 


terminant shift, deluded patients show a sig- 
nificantly greater over-all shift in Rorschach 
determinants. (The shift on pure form is con- 
sidered the index of total shift.) Deluded pa- 
tients also shift more on FC, Total C, and V, 
while hallucinated patients shift more on M 
and YF. All differences are significant at the 
05 level. For both groups, however, the 
amount of shift on M, YF, and V is negli- 
gible. The differences for these three determi- 
nants, while statistically significant, are not 
psychologically meaningful. 

When the arc-sine scores are considered, the 
deluded patients show significantly more shift 
for F, FY, FC, Total Y, and Total C. The 
differences between groups in shift for FC 
and Total C account for the significant differ- 
ences found between the groups for these 
same determinants when they are scored by 
the conventional method utilizing the re- 
sponses on both free association and inquiry. 


Discussion 


The differences in determinant shift sug- 
gest that deluded patients are more reactive 
to the stimulus value of the examiner. In the 
free association situation the two groups show 
little difference except for M and V. When by 
means of the inquiry the subjects are brought 
into closer interaction with the examiner, the 
delusional patients respond to a greater ex- 
tent by elaborating on a greater number of 
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responses. It is noteworthy that the deluded 
patients show the most shift from pure form 
to the color determinants. In the past, Ror- 
schach workers have taken the presence of 
color to indicate capacity for affective rapport 
and for reacting to external stimulation. The 
deluded patients appear to show a greater 
Teactivity to external stimulation and more 
ability to modify their reactions in response 
may, however, 
anxiety in re- 
lating to the examiner (increase in shading), 
human move- 
ment responses on the free association. This 
could be interpreted as a tendency on their 
part to be more concerned with themselves 
Since the fre- 
oth groups, this 
arly meaningful, 
inating patients 
al patients more 


nificant at .10 level). 
The findings reported 
tentative and subject to 


R. G. Gibby, B. A. Stotsky, R. L. Harrington, 


and R. W. Thomas 


The major finding of the study is that the 
two groups of patients, homogeneous with re- 
spect to R, differ significantly with respect to 
determinant shift. Further, when the determi- 
nants are scored by the conventional method 
utilizing both free association and inquiry, the 
shift from free association to inquiry is re- 
sponsible for the differences found between 
the two groups on two of the significant vari- 
ables, FC and Total C. 


Summary 


1. A new method for scoring the Rorschach 
by means of the shift in determinants from 
free association to inquiry was utilized, in 
addition to the conventional method, to study 
two groups of psychiatric patients. One group 
consisted of patients whose predominant 
symptom was hallucinations; in the other the 
predominant symptom was the presence of a 


delusional system. There were 30 patients in 
each group. 


2. By the conventional Rorschach scoring 
method significant differences were found for 
M, FC, and Total C between the two groups; 
with hallucinating patients showing more M 
and less FC and Total C: 

3. When compared for determinant shift, 
the delusional patients showed more shift 
from free association to inquiry with signifi- 
cant differences for F, FY, FC, Total Y, and 
Total C. 

4. The findings were related to those of 
previous studies. It was concluded that pa- 
tients with delusions tend to react to the 
stimulus value of the examiner in the testing 
situation to a greater extent and with better 
control than hallucinated patients. 
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Changes in Wechsler Subtest Scores with Age 


Robert J. Howell 


Brigham Young University 


Sin F 
Bellevue = e introduction of the Wechsler- 
investigati ntelligence Scale for adults many 
fort to Ttr have been conducted in an ef- 
variation hae the effectiveness of subtest 
e Seka 1 index of mental deterioration. 
Wechsler’s of this article is to examine 
average Sh atid of establishing normal or 
sumptions erioration with age and his as- 
Metin E the variability of this 
echsler ( 

ious constructed his tables of nor- 

e “hold” ion by summing the means © 
hold” test tests and the means of the “don’t 
Binning ae for each five-year age group (be- 
ifference ea age of 20) and dividing the 
of the hold the two by the sum of the means 
and 40), ie (6, pp. 65, 222, Tables 3° 
eing a rati is method may be thought of as 
$r using we of means. Undoubtedly, the ease 
Ictated it, a that had already been computed 
9i Etin A more conventional manner 
compute a. average deterioration would be 
idual we scores for each 1m- 
ine the me in an age group and then deter: 
ay be ‘ana, n of these scores. Such a metho 
t at is, a Be to as a mean of ratios score, 
“oration ean derived from individual de- 
ti ig contea This latter method permits 
"ie jet ot of variability of deteriora- 
en ability a whereas in the former method 
NCE to the yi be estimated only by refer- 
nce there Eset of individual subtests- 
thee? the x no mathematical relationship 
wo methods, any similarity © 


an Tesulti 
Dirj, tin z 
tically, 8 means must be determined em- 


diy 


Seco 
me sb tion a Tengi onay be raised as to the 
clin, © above th 0% and a 20% deterioration 
and With age at allowed for by normal de- 
nite p i being indicative of possible 
athological organic deterioration 
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respectively. Reportedly these figures, 10% 
and 20%, correspond “roughly to deviations 
of minus one PE and minus two PE from the 
mean at age 20-25” (6, p. 66). How these 
figures were obtained is difficult to ascertain, 
since the deterioration score resulting from 
summing each don’t hold test score one PE 
below its mean is 18% at this age interval. 


Method 


tempt to investigate these two prob- 
tests of the Wechsler-Bellevue In- 
Form I, were administered to 
orn white subjects ranging in 
age from 20 to 89 years. All of the subjects 
were considered within the normal range SO 


far as behavioral adjustment was concerned. 
oup was drawn at random 


e University of Utah Coun- 
Being college students, they 
would be expected to score somewhat above 


average on the subtests the sam- 
imarily from the urban and 


t Lake City. Thirty- 


In an at 
lems six su 
telligence Scale, 
397 American-b 


eight 0 
resided in private an 
the aged, while the remaining 
community. All of this group were free from 
any apparent handicaps that might have af- 
fected their performance on the test battery. 
e six subtests were Information, Com- 
prehension, and Vocabulary (comprising the 
hold tests), and Picture Arrangement, Block 
Design, and Digit Symbol (comprising the 
don’t hold tests). It should be noted that 
these are not the same tests as suggested by 
Wechsler for measuring mental deterioration. 
Originally it was felt desirable to maximize 
deterioration in studying the nature of the 
two curves. Inspection of Wechslet’s origin: 

standardization data (6, p. 222, Tables 39 and 
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40) shows that the first two tests (Vocabulary 
is not reported) are the most resistant to in- 
creasing age and the last three the least re- 
sistant. Other investigators (1, 2, 3, 4, 5) 
have found the same results. The use of these 
tests will in each instance yield a higher de- 
terioration score, but since the variability of 
all the tests is approximately equal at each 
age level, it should be possible to draw con- 
clusions as to the variability of deterioration 
as determined by this test battery which 


would apply to the tests that Wechsler em- 
ployed in estimating normal deterioration. 


Results and Discussion 


Table 1 indicates the means and standard 
deviations of each of the subtests at each age 
interval. It should be noted that the first 


three tests show little decline with advancing | 


age, while the last three decline progressively, 
finally to about half the magnitude of the 
hold tests. Undoubtedly the older persons’ in- 


Means and Standard Deviations of Subtests | 


Table 1 


Pict. Block Digit 
Age N Info. Comp. Vocab. Arr. Design Symbol 
20-24 135 12.30 13.47 11.88 12.28 13.18 12.61 
2.00 1.92 2.06 2.06 2.73 2.24 
25-29 65 oe 14.43 12.58 12.29 13.72 12.51 
88 1.91 1.84 2.94 2.24 2.35 
30-34 26 12.85 13.69 12.77 10.81 12.42 10.92 
3.21 2.73 3.29 3.25 3.12 3.06 
35-39 12 11.33 11.08 11.08 9.08 9.75 9.75 
3.40 4.13 3.30 3.50 3.84 4.04 
40-44 10 1140 13.00 11.40 8.80 9.70 9.10 
67 3.61 4.03 3.19 3.62 3.30 
4549 
10 1200 14.20 12.80 9.90 10.50 9.10 
Fes j 2.93 2.68 3.14 3.14 3.01 
54 
18 1 100 12.17 11.50 8.33 9.83 8.17 
: .16 2.14 2.01 2.11 2.52 2.48 
5-59 
21 109s 11.67 11.28 7.76 8.67 6.90 
.33 3.10 2.57 2.65 2.93 2.56 
60-64 20 
ae 11.40 11.80 7.50 7.80 7.05 
KA : 2.78 2.23 3.01 2.27 2.69 
23 
ae 11.83 11.52 6.96 8.13 5.87 
rm 2.16 245 2.31 2.83 1.83 © 
74 21 10.90 11.28 11.38 
2.89 ia 2 5.52 6.05 5.43 
2.17 1.62 
75-79 16 10.62 10.9. Es Kr 
. .94 
3.16 208 Hae 5.69 6.19 4.50 
o re i 2.44 2.77 2.42 
80-84 . 9.31 
3.08 2.02 "208 iss aioe 40 
85-89 4 9.25 ae ne 


12.25 


1.05 2.28 71 zo 40 4.00 
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DETERIORATION (%) 


o 


aa 


“RATIO OF MEAN! 
ROBABLE ERROR VARIABILITY 


AGE 


Fig 
+ 1. Pere 
entage deterioration scores by ages: 


mean of ratios, 


tion scores. 


abilit: 

actor Oars rapidly was 2 contributing 
h igit nae particularly in the case 
ave little eff ol; however, time seemed to 
ture Arran: ect on their ability to solve Pic- 
dividual gement and Block Design. Once an 
Se it rin issed one of the stones or de; 
Pete a Subs unusual for him to correctly com- 
Uni ea ieee coe one regardless of the time 


Fi 
gure 1 indi 
indicates the deterioration curves 


com 
Vari puti 
atiability. a by each method as well as the 


Cc 

Ae virt It should be noted that the two 
uall; 
x y overlap each other at all ages- 


ausib 
eras en aarp of the similarity ° 
ation o fs) ae seem to be in the op- 
are © Noted cae factors. It should 
age . sentially as the deterioration curves 
ings age. Tis an ee throughout the entire 
his UD to the s corroborates Wechsler’s find- 
age of 55 and adds strength to 


Rope MPtio 
Ups, ms of linearity in the older age 


It can be se 


variability at 
had assumed. 


ure 1 reveals the va 
constant throughout. In or 


mately ¢ 


Wechsler’s assumption 
age interval was 10% (0 
deviation units) 


cluded that Wechsle 
variability of de 


terioration 4 


ratio of mea 


age 20-24 is 


en from Table 2 


t ratios wel! 
tween this theoretical variabil 
derived variability 


mber of su 
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“MEAN OF RATIOS” DETERIORATION 
S" DETERIORATION 


49 50-54 55.59 60-64 65-69 70-74 75-79 80-84 85 


-89 


ns, and variability of deteriora- 


that the PE 


10%, as Wechsler 
inspection of Fig- 


riability to be approxi- 


der to test 


the PE at ea 


a 

r 14.8% in standard 
e computed be- 
ity and the em- 
(Table 2). In 
age 80-84, was the ż ratio 


study was the 
bjects at each 


but it may be tentatively con- 


bove normal 


rs assumptio 
terioration at all 
should be noted, however, that 


n of equal 
age levels 


determine the va- 


and 20% de- 


dicative of 


| 
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Table 2 


Variability of Deterioration Scores at Various Ages 


.089 +132 34 : 
* Significance of the difference between the observed variability and a variability of .10 (10%). 


pathological organic damage. This is a clini- 
cal problem and not a statistical one, 


The assumption of equal variability of de- 


terioration throughout the life span may ap- 


stant throughout the age span. It was con- 
cluded that: 


r 


1. Even though there is no mathematical 
elationship between the two methods 0 


Variability Variability 3 5 

Age N (PE) (SD) t ratios* È 

5 .105 .156 84 >A 
pee ‘a .090 134 1.17 a4 
30-34 26 101 -150 10 : 
35-39 12 159 .235 1.81 Sle 
40-44 10 067 .100 2.18 >. 
45-49 10 096 -143 16 Sl 
50-54 18 090 .133 68 >A 
55-59 21 101 149 04 > 
60-64 20 082 121 1.42 >A 
65-69 23 .089 -132 84 >.1 
70-74 21 075 .111 2.18 <.05 
75-79 16 .091 135 54 >.1 
80-84 16 .057 .085 4.20 <.001 
85-89 4 >A 


pear, at first glance, contradictory to the 
widespread idea that with increasing age 

ere is an increase in variability in both 
mental and Physical dimensions, Such have 


Hi y e of deteriora- 
tion may other seemingly 
related factors, 


Summary and Conclusions 

Three hundred and ninety-seyen subjects, 

ranging in age from 20 to 89 years, were ad- 

ministered six subtests of the Wechsler-Belle- 
vue Intelligence Scale, Form I 


computing deterioration, the resulting curves 
were virtually identical. f 
2. Deterioration is linear above the age “i 
55 as well as in the lower age levels, as foun 
by Wechsler. a 
3. There is approximately equal variability 
of deterioration at all age levels, 
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Davis-Eells (“Culture-Fair”) Test Performance 
of Lower-Class Retarded Children’ 


Sidney Rosenblum, James E. Keller 
Wayne County Training School 


and Ned Papania 
VA Mental Hygiene Clinic, Detroit 


reasonable to assume that many lower social 
class children diagnosed “mentally deficient” 
carry such a label mainly because of de- 
sts of intelligence tend to «dis- pressed functioning on intelligence tests sup- 
8S a functi against the lower social class child posedly partial to their middle- and upper- 
Ction of the highly verbal, “academic” class peers, then a group like ours should 
ficantly better on a culture-fair 


It i 
near nee of Davis and his asso- 
the University of Chicago (2) that 


Some of 
dividual be more widely used group and in- 


criminate” 


nature $ 
is Me the items they contain. To remedy perform signi 
p eral Int a ion, the Davis-Eells Test of Gen- test than on the three other instruments un- 
I ara E ce or Problem-Solving Ability, der investigation. 
lig teann air” intelligence test free of read- feioi 
accordas ments, has been developed, which, Metho! ; 
Subjects. Thirty boys with a mean chrono- 


7 ; Ing to i : 
Valid? cet: its authors, provides a more 
estimate of a child's level of intel- logical age of 12-1 (range 10-2 to 13-8), 

and a mean initial IQ of 67.57 (range 55 to 


ectual f 
unctioning b F : 
ecause zs its prob- ) 
s aaaeei a a ituted the experimental population 


ms enti 
rely f 4 
T ne y from experiences common to @ 75), const 
aiy all children ehe are tested. on whom data were collected. Of the group, 
Pye SVal Present investigati designed to 15 were Negroes, 15 were white. Mean length 
uate the An ye i (as of residence in the Wayne County Training 
ance on the Games 5 to 6.7 years). 


School was 2.6 years (range: - 
«Jow-status” for 


d by Eells’ modifi- 


the 

test į 

Si high- be commonly known) of a group : 

Banic) Stade mentally handicapped (nonor Procedure. A rating of 
each subject was determine 


c 
Stang; Sc Ool-aged b a class 
nee of ond to sen ipnr be See with cation of Warner’s Index of Status ciena 
test 9 tained from three other tests: 2 gTOUP teristics.® If the Binet, used initially to select 
(California gence requiring reading ability the group, = ae pone” lee 
WO indivi est o i d six months before, 1 was nis A 
Bence gry dually bP saeco | vali Both the Binet and WISC were administered 
A demin typa T to contain verbally loaded, aca- in counterbalanced order prior to group test- 
toi © items (Revised Stanford Binet ing with the Games, which were given ap- 
proximately three weeks later according to 


ler ntelli 
In elligen, 3 
k e ir eg standardized procedure. Five weeks later, the 


igence Sc ENF: 
n Te ale for Children)? If it 1S 
sues Mi the Wa: 


ering wean yne County Training School, North- Scale, Performance Scale); CMM (California Test 

intenge, 1? Robert H. Haskell, M.D Medical of Mental Maturity). igi : 

J 2 esearch nt; Thorleif G H , BD ” Director 3In terms of Warner's original categories these 

abp btoughon Education. cege, Ph.D, 2 subjects would approximate the lower-lower class 

ler E as the rest of this study the following socioeconomic group. For @ detailed description of 

Ntelligg Will be used: WIS ad 4p (Weebs- this modified class typing see Eells and Davis (2, 
x x ? ’ 


ce 
Scale for Children—Full Scale, Verbal ch. 11). 
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Games were readministered individually. Dur- 
ing this second session an “inquiry” was held 
on approximately half the test’s items (se- 
lected in a random manner) to discover if the 
subjects were choosing right answers for the 
right reasons. The group California Test of 
Mental Maturity was administered two weeks 
later. 


Results and Discussion 


instance, a sig- 


e favoring the 
C-P over the Games was obtained. One 


ve contributed 
Games Performance, 
Several explanations 


can be 
count for the failure of ea 


the Games to reveal 


Sidney Rosenblum, James E. Keller, and Ned Papania 


Table 1 


Comparisons of Davis-Eells Games with Binet, 
WISC, and CMM 


Test 


Mean SD t 

Games 64.65 8.02 
Binet 65.87 5.03 -88 
WISC 

FS 66.53 6.46 1.57 

Vv 66.63 5.09 1.38 

P 72.67 10.09 4.31* 
CMM 66.47 7.07 1.24 


* Significant at .01 level, 


contend, the conditions under which the test 
was administered to our group cannot be said 
© have been completely free of middle-class 
cultural overtones. The Games were given to 
our subjects in a school building on a school 
day by middle-class individuals undoubtedly 
identified with the school system. Although 
the group was solving problems via pictures 
rather than responding to a series of aca- 
demic-type items, the materials used in this 
Process were pencil and Paper, the basic 
physical ingredients involved in most school 
work. Although presented to them as a series 
of games, which Davis and Eells claim will 
encourage a child to exert maximum effort, 
our subjects were not fooled and revealed by 
their comments that they knew from the out- 
taking another test. Since 


} ed middle-class peers, it 
might be reasonable to assume that similar 
feelings were aroused in our subjects during 
he Games, and that these 
gative effect on their per- 
r words, what is being sug- 
r method of group adminis- 
tration of the Games did not elicit the highly 
r on the part of our sub- 
be expected from a sample 
class peers, 
2 an Hiternative explanation for our findings 
aba a Subjecis are genuinely deficient in 
would a. Wins ability, and that this deficit 
Ould manifest itself Not only in a middle- 
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a ae but in their own lower-class cul- 
tained ois as well. Analyses of the data ob- 
a in individual inquiries lend support 
so a hypothesis. Our subjects made 
mili the Games not because they were 
A o with the content of the items but 
tions a. HE failure to make correct associa- 
i ominie crucial differences, and 
fe elements of a problem into a mean- 
gful pattern. 


Table 2 


Per 
eee of Subjects Giving Correct Reasons for 
‘ect Responses on the Davis-Eells Games 


men Percentage 

Probabilities 10 

oney 0 

Best Ways 47 

Analogies i 

All items 0 
i 

Ta : 

age We 2 gives a tabulation of the percent- 
thei subjects giving correct reasons for 
ie be seen 


rect Games responses. It can 
a ponses. 

is pot one of our 30 subjects was able, 
e ae ing, to verbalize the reasoning 
e chose have used for all cases for whic 
Cite a gt the correct answer. Davis and Eells 
929 of dy (4) in which it is indicated that 
Who marked viet of normal school children 
Problem: ed right answers for the “analogy 
Ship uae explained the analogous relation- 
Table 7 rectly in an interview. The figures © 
tion we indicate that only 3% of out popula- 
Single i eanle to do this, and that not @ 
Solving ject used the correct approach 1m 
tests de e “money” problems. Both these 
Muire eo apal abstract approach and re- 
8 symb Subject to use a series of interven- 
lem, « olic mental steps in solving the prob- 

E Ca ways” and “probabilities,” whi 
a aTe a less abstract set, were han- 
mewhat better, but even with these 
© percentage of subjects giving correct 
` ae correct answers is not very M8 ®- 
Port the tal, then, these data tend to sup- 
ety im now widely accepted view that one 
veg BE Ortant condition in cases of mental 
tt May 7 is the lack of ability to abstract. 
e, as McCandless (3) and others 


have indicated, that membership in the lower 
social classes tends to produce this concret- 
istic mode of thinking, and that our group 
represents an extreme example of this phe- 
nomenon. Whatever the explanation, our 
study suggests that performance on the Davis- 
Eells Games is as much affected by this loss 
in abstract thinking ability as are other tests 
of intellectual functioning. 

In closing, it should be pointed out that 
the experimenters have been concerned only 
with the ability of the Davis-Eells Games to 
tap an intellectual potential not revealed by 
other standardized tests of intelligence. The 
present investigation strongly suggests that 
they do not do so with our population. How- 
ever, the test may prove useful in another 
by predicting the ability of children to 


way— 
handle the practical problems peculiar to 


daily Training School living that are not re- 
vealed or suggested by school achievement or 
routine test performance. The authors of the 
Games state their test requires the subject to 
use mental activities also required in “soly- 
ing most problems in life and in the school 
curriculum” (1), but to date no work has 
been published to demonstrate the validity of 
their assumption either with an institutional- 
ized or noninstitutionalized population. It is 
one thing to prepare an operationally sound 
test to define a concept such as problem-solv- 
ing ability; it is entirely another matter 
whether the test is useful in the sense that it 
predicts the behavior it purports to measure. 
As yet, we do not know the types of behavior 
the Games predict for our specific population. 
Further research will be needed to answer 
this question and to investigate the poten- 
tialities of this test for use with the high- 
grade mentally handicapped child. 


Summary 


ine if the Davis-Eells (culture- 
fair) Games would tap an intellectual poten- 
tial not revealed by other tests of intelligence 
and reveal a “truer” picture of the level of 
functioning of a group of lower-lower social 
class, high-grade mentally handicapped (non- 
organic) children, the Games were adminis- 
tered to 30 school-aged boys ìn residence at 
the Wayne County Training School. Results 


To determ 
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were compared with those of three other 
standardized intelligence tests: the Binet, 
WISC, and California Test of Mental Ma- 
turity. 

In general, it was concluded that for this 
population the Davis-Eells Games do not 
tend to reveal a “hidden intellectual poten- 
tial”—by virtue of their elimination of cul- 
turally unfair items—not tapped by other in- 
telligence tests presumed to be culturally 
biased. Several explanations are offered for 
this finding, and Suggestions for future re- 
search with the Games are indicated. 
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A Sexual Deviation Scale for the MMPI 


James T. Marsh, Jessamine Hilliard, and Robert Liechti 


School of Medicine, 


ae spol represents the preliminary find- 
SeT the development of a sexual deviation 
one fe the MMPI. The work was done as 
ed on of a research into biochemical and 
agri’ factors in sexual deviation.* 
in answ: entative MMPI scale was constructed 
dividu A to the question whether or not in- 
e convicted of sex offenses can be dis- 
sonalit ed on the basis of an objective pêt- 
Tla test from presumably normal indi- 
offen s having no records of arrests for sexual 
ses. 
hie space capable of this discrimination could 
ace: adjunct to established clinical 
sexual ures in the diagnosis and treatment of 
could te Sea eer In addition, such a scale 
the sel nd application as a screening device m 
Close ection of individuals for work involving 
Se contact with children. 
or i ena was chosen as the instrument 
tered udy since it is objective, easily adminis- 
of a scored, and includes a wide range 
Taits s tapping attitudes, affects, personality 
See symptoms. The variety of items 
Sents a in the MMPI in particular repre- 
since T advantage for a scale of this type, 
asis S possible discrimination on the 
attitude items not directly related to sexual 
accessibl or experiences, and thus may be less 
Subject e to modification by the defensive 
Most f who seeks to present himself in the 
avorable light. 


Subjects 


S 

e ee s. The sex offender population 
Offense = ae of men convicted of some Sex 

1¢ nd committed to the Metropolitan 

Aire ee jointly by the 
Metropolitan, California at Los Angeles and the 

om the leri State Hospital, supported by grants 

egislature of the State of California. 


Medical School of the 
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University of California at Los Angeles 


State Hospital for observation, diagnosis, and 
treatment under the provisions of the Cali- 
fornia Sexual Psychopath Act. They ranged 
in age from 17 to 70 years, with a mean age 
of 36 years. Eighty-five per cent were na- 
tive-born white men, and approximately 11 
per cent were of Spanish-American origin. 
Intelligence levels, as measured by the Ship- 
ley-Hartford or Beta tests, were approsi- 
mately normal in distribution although slightly 
skewed toward the higher intelligence ranges. 
‘Almost 60 per cent of the group had records 
of one or more previous convictions, two- 


thirds of which were for sexual offenses. Acts 
leading to hospitalization under the Sexual 
Psychopath Act include indecent exposure, 
child molestation, rape, and homosexual con- 
tacts with minors, the majority of these of- 
fenses involving sexual activity with children. 

All sex offenders committed to the hospital 
for observation and diagnosis are given a bat- 
tery of psychological tests which includes the 
group form of the MMPI. The tests are ad- 
ministered within the first few weeks after 
admission. The MMPI records utilized in 
the present study were obtained from the 
hospital files. 

Comparison subjects. These subjects were 
drawn from a population of male students in 
education at U.C.L.A. They ranged in age 
from 18 to 47 years, with a mean of 30 years. 
The group was composed both of full-time 
undergraduate university students and indi- 
viduals active in the field of education who 
were doing graduate work toward advanced 
degrees. The latter included superintendents, 
principals, and teachers from the Southern 
California area. The mean intelligence and 
education levels for this grou 


p exceeded that 
of the normal population. These students 


are routinely given a battery of psychological 
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tests including the MMPI during the course 
of training. Records used in this study were 
drawn from the files of the education depart- 
ment at U.C.L.A. 


Procedure 


Construction of the scale was begun by 
drawing 100 MMPI records in the form of 
machine-scoring answer sheets from the hos- 
pitalized offender population and 100 records 
from the normal population. These were sub- 
jected to item analysis. A compléte count 
was made of the true and false responses on 
each of the 566 MMPI items for both nor- 
mal and sex offender groups. The number of 
true and false responses for each group on 
each item was then tabulated and this tabu- 
lation carefully inspected item by item for 
differences between the two groups. In each 
instance where considerable difference in the 
Proportions of true and false answers ap- 
peared, a chi-square test was applied to de- 
termine the probability that such differences 
may have occurred by chance. In those in- 
stances where the number in 


fourfold chi-square table fell below five, 


form booklet, are reproduced here.2 


Sex offenders, i 
tend to answer as 
94, 98, 106, 111, 40, 144 
158, 168, 170, 179, 239, 249, 260, 297, 298, 303, 
316, 329, 346, 348, 349, 350, 352, 360, 364, 365, 373 
375, 377, 378, 382, 385, 389, 395, 404, 413, 419, 427, 
489, 490, 

507, $48, 549, 558, 559, and 562’? 19 492, 498, 


O o 
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To test the possibility that these 100 items 
might be of discriminative value, an MMPI 
scoring key was constructed from the re- 
sponses of the sexual offender group. Scores 
for these items were then obtained for 200 
additional sex offender records and 145 new 
student records. Each response in a deviant 
direction (i.e., answered in the same direction 
as the original sex offender group answered 
it) was scored as one unit with the possible 
range of scores extending from 0 to 100. The 
actual range of items answered in a deviant 
direction for this total sample of 345 records 
fell between 10 and 70, 


Results 


The distribution of scores for the sex of- 
fender and comparison groups obtained on 
the new scale is presented in Table 1. The 
mean number of items answered in the deviant 
direction by the hospitalized sex offenders 15 
42.1 with a standard deviation of 9.3, while i 
that of the comparison student group is 2 13 
with a sigma of 6.5. The best cutoff point 
to distinguish these groups seems to lie be- 
tween 30 and 31 items. P 

For cross-validation purposes, two neW 
samples were drawn from the sex offender and | 
comparison populations and scored on the , 
sexual deviation key. These samples con- | 


Table 1 


Distribution of 145 Normals and 200 Sex Deviates 
on a 100-Item Sexual Deviation Scale 


Frequency 
O Pe eee 
MMPI scale Normals Sex offenders 
score (V=145)  (N=200) 
66-70 2 
61-65 3 
56-60 14 
51-55 26 
46-50 31 
41-45 5 30 
36-40 4 <36 
31-35 12 38 
26-30 22 9 
21-25 38 9 
16-20 39 2 
11-15 25 
6-10 3 
0-5 
pM pp 
sD 213 42.1 


OF CASES 


NO. 


10 
NO. OF M 


Fig. Res 
8. 1. Distribution of scores on MMPI sexual de 


317 st 
ud f 
ant direction The abscissa represents the num 


tai 

owe Sex offender records and 172 stu- 
in t OE on Distribution of cases and means 
at of eh groups so closely approximated 
Sible to 3 original samples that it was pos- 
tion data. ombine validation and cross-valida- 
eure 1 illustrates the graphic distribution 

offenders. pinen samples, 317 normals and 33 

devi he mean number of items answere 
omparig, iant direction by members of the 
deviation o group is 21.8 with a stan ard 
1.7 wi a 6.8, while the sex offender mean 
able ith a standard deviation of Os 
2 presents the distribution of the 


Combi 
al j H . . 
Ples o ed validation and cross-validation sam- 


and T the new scale. Scores of 283 normals 


a Sie ndersifal below a cutoff point 
Sof ies 30 and 31 items, whereas 
e. fas normals and 297 sex offenders fall 
Sse gro is scale appears to differenti: 
“ince it ups with a high degree of efficiency 
penera e ecily identifies 3g per cent of of- 
cent o and misclassifies only about 11 Pet 
+ 


f 
the comparison subjects. 


Place 
Score. 


20 
mpi SCALE ITEMS ANS WERED 


viation sC 
ber of items from the 100 
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70 


50 60 


ale for 338 hospitalized sex offenders and 
-item scale answered in a devi- 


Table 2 


Distribution of 317 Normals and 338 Sex Offenders 
on 


the Sexual Deviation Scale 


SS SS 


Frequency 
MMPI scale Normals Sex offenders 
score (N=317) (N= 338) 
71-75 1 
66-70 2 
61-65 9 
56-60 20 
51-55 33 
46-50 54 
41-45 4 64 
36-40 il 58 
31-35 19 56 
26-30 46 23 
21-25 89 14 
16-20 93 3 
11-15 50 1 
6-10 4 
1-5 1 
Mean 21.8 41.8 
SD 68 9.1 
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Discussion 

With a view to gaining a clearer under- 
standing of factors contributing to high and 
low scale scores, cases falling at the extremes 
of the two distributions and in the area of 
overlap were carefully inspected. Screening 
interview notes and psychological test data 
were available for the education student com- 
parison subjects with high and low scale 
scores, and upon inspection of these it was 
evident that personality difficulties had been 
noted in almost every case where sexual devia- 
tion scale scores exceeded 35 items. The fol- 


lowing notes are typical of many cases in 
this range: 


Scale score 39. “Referred for psychiatric counsel- 
ing with history of extreme irresponsibility. Lives 
in parasitic relationship with mother figure. In in- 
terview stated inabilit 


78, D 84, Pd 86, 


“Referred for Psychiatric counsel- 
ic skin disorder. Wishes further 
in treatment. MMPI scores above 


ing. Psychosomat 
therapy and now 


Referred for Psychiatric counsel- 
chess enthusiast. Lives with aunt 
and mother. Bright but Socially inept. Difficult 


esulted in depression and ‘nervous 


a Approved for teaching after further 
testing. No MMPI scores above 70,” 


le score 44, “Referred for Psychiatric counsel- 


ills. Very religious, recently 
ch by wife after ‘ 


personality maladjustment, 
Sex offenders with high and low s 


ories and Probation 
the sexual offend 


cale scores. 
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nosed as cerebral arteriosclerosis was „also 
found in this group. In addition, these indi- 
viduals had completed on the average fewer 
years of schooling, and tended to be older 
than those with the lowest scores. When 
MMPI scale scores were compared for these 
extremes, it was found that those with high 
sexual deviation scores also had significantly 
higher scores on the F, D, Pa, Pt, and sa 
scales. A significant difference was also foun 
for the K scale, high deviation scores being 
associated with low K values. : 
Scale scores of neurotic and psychotic Pa 
tients. As a further check on the discrimina- 
tive value of the scale, MMPI records of 50 
neurotic and 50 psychotic patients at Metro- 
politan State Hospital were scored with the 
sexual deviation key. Scores ranged from 21 
to 60 items answered in a deviant direction- 
In general, psychotic patients received higher 
deviation scores than neurotics, their mean 
falling at 39, whereas the mean for the neu- 
rotics was 36. The distribution of scores sug- 
gests that the scale does not discriminate sex 
offenders from hospitalized mental patients. 
The overlap in the distribution of scale scores 
for these two groups lends support to the 
hypothesis that some factor of personality in- 
tegration or adjustment is being measured by 
the scale. Scores from both groups appear tO 
be distributed in accordance with such a fac- 
tor since the lowest scores in the psychotic 
Sroup were obtained from patients diagnosed 
as paranoid schizophrenics whereas the high- 
est scores were from catatonics and hebe- 


phrenics. This js compatible with the clinical 
finding that paranoi 


retain a better 
schizophrenics, 


MMPI items composing the sexual devia- 
tion scale. The majority of the items which 
differentiate hospitalized sex offenders from 
comparison subjects can be grouped into cate- 
gories in accordance with attitude or feeling 
content, The pattern of these items, although 
not descriptive of any single individual, yields 
a rough, self-descriptive picture of the hos- 
Pitalized sex offender which agrees quite 


closely with clinical observations reported i# 
e literature, 


reality contact than other 


are often characterized as fearful, 
t, inadequate individuals who are 
and inept in social relations. MMP. 
» 138, 140, 147, 304, 389, 395, and 459 


d schizophrenics as a group ' 
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an answered by sex offenders in the direc- 
tions a ich illustrates this point. Poor social rela- 
Rie a particularly evident by their answers to 
ency to oe 377, 404, 449, 455, and 547. A tend- 
thought e suspicious and to project unacceptable 
aia feelings on others is shown by their 
ee ee 347, 364, 376, and 507. That 
ships an <A difficulties may date back to relation- 
items 118 experiences in childhood is suggested by 
Pitalized 419, 453, 458, and 562. As a group, hos- 
which ar sex offenders are subject to many fears 
5, 352 A often unrealistic, as illustrated by items 
from a 0, 367, 385, 492, and 559. They suffer 
aa a of mental and physical complaints as 
349, 350 in items 51, 63, 139, 155, 160, 163, 168, 346, 
ated N pan 365. Guilt and depression, probably re- 
ings z deviant sexual behavior, are prominent feel- 
158, 375. evident in items 49, 61, 67, 76, 84 106, 
pressive 379, 382, 413, and 489. The guilt and de- 
of tabo reactions may stem in part from violation 
igious = laid down by strong fundamentalist re- 
aaa convictions ae da items 98, 249 373, 
area is ¢ and 490. The focus of conflict in the sexual 

8, 3e pereat in items 20, 37, 133, 179, 297, 427 
apparent 358, Some asocial and amoral attitudes are 

nt in items 144, 289, 294, 298, and 316. 


a E variety of categories into which items 
ieee points to a broad base for the 
Se power of the scale. 
ising ations of the scale. Despite the prom- 
Scale preliminary results obtained with the 
is ie usefulness for diagnostic purposes 
Of the acted, at present by the selective nature 
Offend validation groups. The hospitalized sex 
Sentatiy group cannot be considered as repte- 
ende; Dr of the total population of sex of- 
is rs since several factors operate to screen 
i Sow One screening factor is the ratio 
at 5 me to arrests. It has been estimated 
attests, y a fraction of sex offenses results in 
arrest r curte the majority of individuals 
Commi and convicted of sex offenses are not 
Ment itted to hospitals for care and treat- 
ct, pot the California Sexual Psychopath 
basis F individuals are committed on the 
Bressiy, first offenses unless these involve a8- 
ese : behavior or minor victims. In view 0 
Sed Selective factors the sex offender group 
a te this study may not be representative 
be aie total population of individuals who 
7 S sexually in ways which violate the 
idi S however, represent & group of 
iatrists s who, in the best judgment of SA 
angero and the courts, must be considere 
ecause of to the health and safety of others 
e of aberrant sexual behavior. 
comparison group drawn from a stu- 


ent 5 ` 
Population is also subject tO selective 


factors. Certainly, this group is atypical of 
the general population in terms of educational 
level and possibly atypical in terms of socio- 
economic background. The fact of college at- 
tendance presumes also a degree of sophistica- 
tion in terms of tests which the majority of 
sex offenders have not had the opportunity 
to acquire. 

In view of these limitations, diagnostic ap- 
plication of the scale should await further 
validation with new groups. In particular com- 
parison groups with socioeconomic, educa- 
tional, and experiential backgrounds similar to 
the sex offender group are needed. The scale 
is presented at this time in the hope that 
other interested investigators may extend its 
range of application through further valida- 
tion. 

Summary 

In the effort to develop an MMPI scale to 
distinguish sex offenders from normals, re- 
sponses of 100 hospitalized sex offenders and 
100 normal education students to 566 MMPI 
items were subjected to item analysis. One 
hundred items were found which differentiated 
the two groups at a statistically significant 
level in terms of direction (true or false) of 
response. 

These items were combined into a scale for 
which scoring keys were constructed. The 
scale was applied to new samples of 338 hos- 
pitalized sex offenders and 317 education stu- 
dents. Utilizing a cutoff point of 30 out of a 
possible 100 items answered in a deviant di- 
rection, the scale was found to discriminate 
between groups with but 12 per cent false 
negatives among sex offenders and 11 per 
cent false positives among normals. 

Cases with scores at the extremes of the 
distributions of both groups were examined 
for possible factors contributing to the scores. 
The items discriminating offenders from stu- 


dents were combined into clusters which de- 


scribe some personality features of sex of- 


fenders. 
Received May 10, 1954. 
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The Relationship of the Wechslet-Belleyvue Verbal 
Scale and the Progressive Matrices Test' 


Mahesh M. Desai 
Belmont Hospital, Sutton, Surrey, England 


In view of the fact that the Progressive 
Matrices (PM) and the Wechsler-Bellevue 
(WB) are both regarded as good measures of 
intelligence, the two tests are compared in 
this study. A group of 190 consecutive male 
admissions to the hospital were given the PM 
as a group test during the second week after 
admission, and within the following 3 days 
they were given 3 or 


age was 31.7 (SD, 8.8) 
and the socioeconomic status almost wholly 
lower-middle or working class. Psychiatrically, 
121 were neurotics, 30 psychopaths, 13 or- 


ganics, 9 early schizophrenics, and 17 miscel- 
aneous. 


Product moment 7’ 
PM and WB weight 
as well as f 


Scores of 10.8 
11.2, 9.4,-10.6, 10 3, and 11.4, respectively, 
The 7 of PM with WB Was .573, which rose 


to .648 when Corrected for at: 


tenuation. Th 
7’s of the subtests : 


were J, 33; C, 


tudy may be ob- 
Desai, Belmont 


with PM 


1An extended report of this s 
tained without ch 
Hospital, Sutton, 
the American Documentation Insti 
from the latter source, 
from ADI Auxilia 
plication Service, 
2550 Ci, remitting in advance $1.2 
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47; D, 41; A, 49; S, 50; and V, .34, vie 
rose to I, .37; C, .57; D, .52; A, .65; S, HA 
and V, .38, when corrected for attenuata 
change of grades based on percentiles W 
found in 109 Ss, 88 of whom were higher nai 
21 lower by one grade or more in WB th 
in PM, ee 
The over-all 7 is not as high as might E 
expected in two very good measures of g . EY 
after correction for attenuation the & is a 
-762, making E no more than 23.8. V nae 
have the lowest 7’s in our sample. Part of ly 
explanation for this might be in the rela 
lower reliability of PM in psychiatric be 
and in the fact that V and J are less Me: 
able to age or psychiatric illness than ot! rt 
WB tests. The last fact might also in Pan 
explain the improvement in 88 Ss. The dite 
ences in the structures of the two tests a 
Probably very important in explaining t 
relatively low y and the change in gradings 
PM being a measure of present efficiency a? 
involving eduction of relations and corn 
lates, WB largely measuring g through wha 
it has already achieved in the past. The high- 
est correlations of A (Arithmetical reasoning) 
and S (eduction of relations) with PM migh 
also be partly explained on this basis. Other 
variables which may have influenced the dis- 
Parities are the effects of the sequence 1” 
which the tests were given, the mode of a 
ministration (group vs. individual), and dif- 
ferences in the heterogeneity of the tests 
which may have affected attitudes, interest, 
and concentration, 
Brief Report 
Received November 9, 1954. 
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The Relationships Among Five MMPI 
“Anxiety” Indices 


Charles Windle 


Human Research Unit No. 3, Fort Benning, 


pe hin the last twenty years anxiety has 
cent 5 widely recognized as 4 central con- 
Tetized nie (9). Introduced and popu- 
cept ha. y psychoanalysts (3, 8), this con- 
S been adopted even by experimental 
17 ogists to describe motivation (10, 13, 


ee tantly, the widespread acceptance 
s e construct of anxiety is not paralleled 
fee nity in definition. The disagree- 
this ce confusion that exist in defining 
of ete are exemplified by the variety 
ive z iety indices proposed for the MMPI. 
he uch MMPI anxiety scores have come to 
author’s attention. 


1 n 
hain observed that patients classified as hav- 
and H: iety neuroses were similar 
Bested 2 s their highest MMPI scale scores. He sug- 
Bories þ at the combined score of these three cate- 
P. 762) mecaneg “the anxiety score (A score)” 
Scales, th hoben, also, has used these 
arguing se neurotic triad, as 3 measu 
Cases of at “anxiety is the central facto 
~ 2 i, amas game and neurosis” (16, P- 
TERA ¢ et al. questioned whether the Hy scale 
€ Hy wi to the detection of anxiety. They re 
e “the ith the Pt scale as one more likely to meas- 
acteristic vague fears, over-concern, and worry har- 
ethod of an anxiety reaction” (14, P. 84). Their 
© giv of scoring, in which all scores less than 60 
$ ormal” zero weight, is obviously unsuitable for 
D, and pre buations: The simple sum © Hs, 
Useful b scales promises to be 2 D generally 
Study, score and will be employed in the 


3 
eae ee felt that Modlin’s index overlooked two 
Tan ares of the anxiety profe, “the anticlinal 
on Py» eee to Hs and Hy, and the secondary Tse 
, p. 66). His proposed formula, 


Ur 


Anxi 
riety Index = Z + D+ 
3 


+[(D +P) — (Hs + Hy) 
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Georgia 


was found to follow clinical expectations when ap- 
plied to various psychiatric and nonpsychiatric 
groups. 

4, Winne proposed a 30-item scale of neuroticism 
based on a contrast between the responses of neu- 
rotic and normal veterans. Only items from the Hs, 
D, and Hy scales were used. In describing this eat 
Winne noted “the diffuse or free floating anxiety 
measured by this adaptation of the MMPI” (24, 
p. 120). It seems reasonable to assume that Winne 
conceived of this scale as @ measure of anxiety. 
Holtzman et al. (7) have made this same interpreta- 
tion and even used Winne’s scale to “validate” the 
Taylor anxiety scale. 

5. Taylor (19, 20) constructed a “manifest anxiety 
scale” from items i i reed were in- 
dicative of manifest anxiety? Her scale was devel- 
device for selecting experimental subjects 
“state of reactivity or Ex- 
cts their general level 
of drive ( 120). Numerous studies (2, 12, 
18, 19, 21) have presented evidence that ex- 
the basis of Taylor anxiety 
scale scores differ in performance jn a manner pre- 
dictable from Hullian theory. 


To date, there is little evidence for pre- 
ferring any of these anxiety indices (with the 
possible eaception of the Taylor scale) over 
any others, nor is there adequate evidence as 
ther relationships found with one index 
be found with others. Previous 
studies (1, 4; 7) have been limited to inter- 

1 As Holtzman ét al. (7) bi 
ber of items used in computin 
has varied considerably in 


The same appears to be true 
used. The scores jn the present study were based on 


the list of 50 items presented by Taylor (20, p. 286)- 
The MMPI numbers of 
14, 18, 23, 31, 32, 43, 67, 86, 
186, 190, 191, 2175 
301, 317, 321, 322, 
407, 418, 424, 434 439, 
549, 555. 


335, 3375 
442, 499, 
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Table 1 
Intercorrelations and Reliability of Anxiety Scores of 55 Females on Two Administrations of the MMPI 


Mean Retest 

Anxiety correla- a, 
measures Purcell’s Welsh’s Winne’s Taylor’s tion coetfic 

in’: la -36(.08) 35(.27) 37 (.31) +45 (.30) 80 
Purcell’s ee '36(7) 346% 83(.82) 75(.71) 9 
Welsh’s 33 (.44) 74(.61) 63 (.53) 79 
Winne’s 56(.65) 45(.51) 9 
Taylor’s 66(.63) 


relating only three of the five MMPI anxiety 
indices. In addition to their limited scope, 
these studies suffer from minor inaccuracies 
in the indices used, and from the need for 
cross validation. 

The present study proposed to determine 
the interrelationships of all five anxiety in- 
dices within a single population, incidentally 


providing an estimate of retest reliability for 
each index. 


Method 
Fifty-five female undergraduate students at 
the State Unive 
MMPI group form twice 


five anxiety indices Proposed for the 
PI were computed. 


Results 


The results of intercorrelating the five anx- 
iety scales are Presented in Table 1, In gen- 
as the most highly re- 
ety indices. The highest 
pear to be between the 
h Welsh’s anxiety index 
scale. It is noteworthy 


score showed general 
other scales, 
reliability coefficients. Item overlap does not 
seem sufficient to account for the results of 


the study. The greatest overlap among the 
five scales is between Modlin’s A score a 
Purcell’s index, whereas the correlation be 


tween these scales is of only intermediate 
value. 


Discussion 


Previous investigators have presented i 
dence both for (4, 5, 7) and against (1, 4, 5 
23) high relationships among anxiety meas- 
ures. The present study also yields evidence 
both for and against high relationships. T 
high correlation of .74 between the Taylar 
anxiety scale and Winne’s neuroticism ee 
claimed by Holtzman et al. (7) was no 
completely confirmed in the present study 
Neither Winne’s neuroticism score nor Mon 
lin’s A score was sufficiently highly correlate 
with the other scales to assume equivalencê 
among them. This conclusion appears doubly 
warranted in view of the item overlap be- 
tween indices and the elimination of change’ 
within subjects over time, a usual source 0 
error variance in correlational studies. 

On the other hand, higher correlations tha” 
have previously been claimed were found be- 
tween Purcell’s anxiety index and both Tay- 
lor’s anxiety scale and Welsh’s anxiety indes: 
The magnitude of these correlations, ranging 
from .79 to «86, is high enough for the use! 


to assume the equivalence of the scales in- 
volved. 


Purcell’s scor 
to each of the 
appear that 


Relationships Among MMPI “Anxiety” Indices 


a Sealy the relationships among these 

Pics op measures is inappropriate be- 

A o the considerable overlap of items 
ong the different scales (6). 


Summary 


thei gems among five “anxiety” 
for both from the MMPI were determined 
female: test and retest of 55 undergraduate 
ures S; Three of the MMPI ansiety meas- 
two hed fairly highly interrelated, while 
all Sy relatively low intercorrelations. In 
and oa index, the sum of the Hs, D, 
relati scales, tended to have the largest cor- 
ions with other anxiety indices. 


Received May 19, 1954. 
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Personality Correlates of Cettain Religious Attitudes 


William E. Broen, Jr. 


University of Minnesota 


A sample of 140 university freshman males 
was selected from liberal arts college class 
lists and divided into three groups represent- 
ing three different degrees of “religiosity.” 
The criterion for the Separation of these 
groups was a Religiosity Index defined as the 
sum of an individual’s standard scores on 
three Thurstone religious attitude scales: At- 
titude Toward the Bible, Attitude Toward 
God, and Attitude Toward Sunday Obsery- 
ance. 

Various personality characteristics of these 
three groups were compared using the MMPI, 
and Welsh’s Anxiety Index and Internaliza- 


tion Ratio. The only significant difference was 
between the religious and nonreligi 


group scoring higher, 
It was felt that the lar, 


: gely negative results 
might have been due 


to an incorrect grouping 
“religiosity” con- 


tained without charge fro. 
524 14th Ave, s. E 


- Broen, Ji 
for a fee from the A; 


Minnesota, or 
entation Insti- 


various aspects of religion should have E 
investigated separately. Therefore, the thr 
attitude scales, each of which was felt to p 
somewhat different aspects of religious belis $ 
were correlated separately with the L sca d 
and the ten clinical scales of the MMPI aa 
with Welsh’s AI. Significant correlations a 
— .24 between the Attitude Toward the Bi 
scale and MMPI D, and + .20 between i 
Attitude Toward Sunday Observance scal i 
and MMPI P£ were found. Both correlation 
were in the hypothesized direction. eh 
Corroborative evidence for the stateme 
that the several aspects of religion are stressa 
differentially in the lives of various persoa 
was found in the intercorrelations of the at id 
tude scales. The Attitude Toward the Bib 
scale and the Attitude Toward God sca A 
(both with a positive belief content) wen 
found to correlate with each other to a mueg 
greater degree than either did with the aun 
tude Toward Sunday Observance Scale wit 
its “thou shalt not” content (r= + .75 VE 
+ .49 and + .44 respectively). The existenc® 
of separate “positive” and “negative” re- 
ligious factors is therefore hypothesized. 
These data Suggest that factor-analytic re 
search in this area might prove fruitful, wi 


the purification of variables leading to more 
Conclusive findings, 
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The Use of Demographic Characteristics in Predicting 


Response to Hospitalization, 


Louis J. Moran, George 


W. Fairweather, Robert 


for Tuberculosis’ 


B. Morton, 


and Laurence S. McGaughran * 


VA Hospital, Houston, 


E 
in ieee ie almost half of all patients 
against ae hospitals leave the hospital 
of such di Sa advice (3, 4). The prevalence 
single Pasay arges constitutes the greatest 
m this a e to the control of tuberculosis 
) indic am Indeed, a recent investigation 
treatment es that the effectiveness of medic 
e maj for tuberculosis is now such that 
remedial t deterrent to success lies not 1m 
unwillin echniques but in the inability oF 
Sary ho ghess of patients to stay for the neces- 
he spitalization period. 
Patients yeo oca problems of tuberculous 
and a sta, ave been the subject of much study, 
Publish eA en te amount of material has been 
cular,” fie the psychology of the tuber- 
tight hac reader is referred to Barker; 
i eon, ad Gonick (1) for an 
With A and critical 1953 review. 
grouped on exceptions these studies may be 
Majority oughly into three categories: 
expert are classified by Barker et al. as 
Servatio opinion.” Typically, these are ob- 
ns on psychiatric, psychological, or 


1 
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chology aan W. Wann, department of psy- 

oUuston he Institute, and part-time stà member, 
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t 
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Tathematicn = by James Hummell, dep?” 
istical consulta- 


ns, 
Irving pe credit is due to Drs. Daniel E. Jenkins, 
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üsts, 
ae comin guidance and support made 


Tofe. 
ology, Uni L. S. McGaughran, department of psy- 
Ember, H versity of Houston, is 4 part-time st 
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Texas 


social aspects of tuberculosis made by various 
specialists in their clinical practice. Another 
large group might be called “ad hoc explana- 
tion” studies. These usually categorize by 
frequency the probable reasons for quitting 
hospital treatment. An excellent review of 
these studies is given by Tollen (4). A third 
group might be categorized as “personality 
determinism” studies. Usually these involve 
the application of psychological tests or sys- 
tematic interviews. Some of the studies in this 
third group seek to describe general “per- 
sonality traits of the tubercular.” Others at- 
tempt to compare the personality traits of 
patients who leave against medical advice 
with those of patients who remain for defini- 


tive treatment. 
Problems of Method 


Without an attempt here to analyze the 
approaches in detail, certain general questions 
concerning methodology may be raised. These 
methodological problems are by no means 
specific to studies of the conditions under 
which some tuberculous patients quit the hos- 
pital and others stay. However, there seems 
to be a particular need in this area for a 

ination of (4) criteria for selection 
) sampling techniques, and (c) 
f relevant variables. 


Criterion. All studies designed to discriminate the 
people who will remain for com- 
who will leave before 
treatment have used the administra- 


characteristics of 
plete treatme 
completion © 
tive designation, 

fit) vs- “irregular” (Against Medical Advice, AWOL, 
or Disciplinary) 
of subjects. 
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The conditions under which either of these ad- 
ministrative labels is applied are so varied, however, 
that they have little meaning as experimental cri- 
teria. For example, in the hospital under study 
here, 186 regular discharges were given in the pe- 
riod 1949-1952. Of these regular discharge patients, 
14 per cent were found not to have tuberculosis at 
all and were quickly discharged, 18 per cent were 
found to have inactive disease and discharged, 12 
per cent left “at their own risk,” 7 per cent were 
discharged while still ill after emergency treatment, 
and only 49 per cent entered with active disease and 
remained in the hospital to follow a definitive treat- 
ment program. 

Hence, an administrative regular discharge may 
include some people discharged without treatment, 
some with still active disease, some treated until 
well, and even some who leave at own risk, which 
is behaviorally equivalent to leaving “against medi- 
cal advice.” Although the irregular discharge cate- 


medical advice, 
e.g., discharge for disciplinary reasons, 


1 ies of irregular discharge, 
sampling has been Postcriterion. That is, subjects 


In an area where so littl 
available, Precriterion sampl; 
portant, Actual behavior in the hospital 

m 
be observed directly. The : fn 
which the behavio 


Measurements may be cana iring theo Peated 
hospitalization. 

If samples are selected 
currently hospitalized patie: 


c s for stratify- 
ìng samples in terms of probable final discharge ions 


f the design, 
often 
necessary for patients to reach the fi 1 years, 


for intensive study from 


greatly facilitated, eg. the reduction of within- 
group variance by the use of stratified samples. 

At present, no technique is available for determin- 
ing upon admission to the hospital the Probability 


`“ 
of regular or irregular discharge. The development 
of such a technique for stratifying samples would 
contribute in a number of ways to intensive studies 
of the process of adaptation to hospitalization. 

Isolation of variables. The usual experimental ap- 
proach to the problem of irregular discharge relies 
on psychological tests or interviews to detect differ- 
ences in personality traits between regular and xg 
regular discharge patients. The assumption implicit 
in these studies is that personality traits, “resident 
in the individual, constitute the crucial determinants 
of his ultimate response (stay or quit) to hospitali- 
zation. 

It seems equally reasonable to assume that other 
factors, entirely independent of personality, may be 
just as important correlates of such behavior as the 
personality that the patient “brings with him” into 
his particular hospital environment. For example, 
two people with hypothetically identical personality 
traits but with different family constellations, differ- 
ent incomes, different stages of disease, of different 
races, etc. might follow entirely divergent paths in- 
sofar as staying in or quitting the hospital is con- 
cerned. Furthermore, patients in the same hospital 
may be adjusting to quite different objective situa- 
tions. Depending on the physical condition of the 
patient, treatment may range from simple rest to 
repeated strenuous procedures (such as months of 
periodic insertion of air into the peritoneal cavity) 
to major, disfiguring surgery. A patient may be 
painfully ill or asymptomatic, comfortably pen- 
sioned or ruined financially, rooming with a friendly 
or unfriendly Patient, etc. 

The contribution of these extra-personality factors 
to the variability of response to hospitalization 
might well obscure much of the variability con- 
tributed by Personality traits if the latter are treated 
independently. Isolation and systematization of ob- 
jective situational differences within the hospital and 
other such extra-personality variables, in a form 
suitable for controlled experimentation, are a logi- 
cal prerequisite to studying the conditions under 
which some patients stay for complete treatment and 
others leave against medical advice. 


The Problem 


The aims of the present study are: (4) 
Specification of simple criteria for final re- 
sponse to hospitalization, and (b) the de- 
velopment of a device for selecting samples, 
on admission to the hospital, with a predicted 


final response (stay or quit) to hospitaliza- 
tion. 


Method 


The criterion for selection of subjects is 
based on a simple Stay-response or quit-re- 
sponse dichotomy, Stay response: the patient 
entered with active disease and stayed until 
discharged by his Physician as having re- 


a O a 
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€ 
mee dequate treatment. Quit response: 
left Se entered with active disease and 
physician opia against the 2 dvice of his 
began a t oth groups entered ill, both groups 
cit Pe program, one group stuck 
present rh other quit in midstream. The 
the other y seeks to predict only one or 
Note E these two final responses- 
dischar at this selection excludes regular 
only e patients who left after diagnosis 
their ong emergency treatment only, oF at 
per est “es This selection eliminates 
and also ies the “regular discharge” sample, 
transfer — disciplinary discharges and 
Data i or expired cases. 
clinical = this study were derived from the 
e = ee pe folders of discharged patients. 
tetas A, record folder of each patient in 4 
account an anon hospital contains an 
certain $ his medical treatment history and 
Cupation emographic data, e.g. 48° race, 0C- 
available won, such items of information 
Several conn the records were selected to serve 
diction cfg iy one of which jnvolves pre- 
Motman final response to hospitalization. 
rom the on on these items was abstracted 
charged ee records of all patients dis- 
latge Gee the Tuberculosis Service of @ 
ere a Medical and Surgical (GM&S) 
thro ministration hospital from March 
trough December 1952. g 
an, total sample, all cases failing to 
Onse aan of stay response of quit re- 
Known» d all cases with more than two “un- 
is left ana abea items were excluded. 
nly 29 total sample of 268 discharges: 
Stracteg f of the 40 information items a°- 
k e ti rom the clinical records are known 
Doha ie a admitted to the 
lied fo nformation on these 22 items wag 
Utting the selected stay and quit groups“ 
al oo were determined by inspection 
Stou s eye uificance of differences between 
aluated by chi square. 


tim hen the; ; 
©, gg ‘Re item of information does not vary with 


ch Bay 

Preys rom i all cases with more than one. s- 
eng Mt any on hospital are eliminated. This is to 
trees th ong 075e from unduly increasing fre- 
Brevig al ne or perhaps both groups Jf the in- 
Neneg os es vary with time, ¢8» number © 
ang p for Pitalizations, each discharge js counte 

P js “people, 


So : 5 
i others « items the sampling unit 1s 
S “discharges.” 


Results 


_Of the 22 items, 9 served to differentiate 
significantly the groups. Items significant at 
least beyond the 05 level were: age on ad- 
mission, service-connected disability pension, 
duration of illness, chronic vs. fresh disease, 
number of previous hospitalizations, type of 
any previous hospital discharge, permanent 
address, psychiatric diagnosis in addition to 
tuberculosis, and occupation. . 

The following items did not reach the .05 
level of significance: month of admission, day 
of admission, war service, marital status, num- 
ber of children, number of siblings, various 
combinations of diagnoses (other than neuro- 
psychiatric), time in service, religion, race, 
stage of tuberculosis (minimal, moderate, far 
advanced), and the number of readmissions 
to this hospital. 

Each of the nine significant information 
items yielded individual probability state- 
ments concerning the quit response, iie; the 
proportion of quit responses to row totals in 
the chi-square tables. However, since these 
items did not represent independent events,‘ 
computation of the probability of quit re- 
sponse by direct combination of these in- 
dividual probabilities was not possible. Nor, 
with a sample of this size, was it possible to 


compute a probability statement that took ac- 
ts. Therefore, no 


count of interdependent even 
de to derive mathematically 
the probability of quit response by means of 
combining «dividual probabilities of the 
i Instead, each patient was assigned 
derived from the nine items. 
f weighted scores was selected 
in preference to a system which assigned a 
patient an unweighted score from 0 to 9, de- 
the number of high probability 
“pit.” On the original sample, the 
a contingency CO- 


4Let A represent the event of a quit response and 
Hh, Ha.. -H the nine known hypotheses. The com- 
bined probability of any two hypotheses is: 


pP(A|H) P(A\H2) 
P(A) [( P(A) PA ) | 


applied to various pairs of hy- 
jn the problem under consid- 
a ji la gives a value 

i jt is found that the formulé 
paar an one in almost every instance. Hence, 


a hypothesis of independence must be rejected. 


When this formula is 
potheses as occurring 
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‘efficient with the criterion of 26, p< .001, 
with the median as cutting point, while the 
weighted scores yielded a contingency coef- 
ficient of .47, p < .001. 

Weighted scores were determined in the 
following manner. The log was ascertained for 
every probability value as derived from the 
nine significant information items. The score 
of a patient was the sum of the nine log 
values that applied to him. This arbitrary 
procedure served only to accentuate the direc- 
tion of individual probability statements and 
to disperse scores. The score merely places 
the subject somewhere on a scale and is not 
itself a probability statement. 
probability of 
scale may then be determined. 


stayed for definitive 


ve discharges in 1953 
of stay response or 
and the same 


response, 


5It should be noted that these are conditional 
predictions. Predictions on current cases must be 
made only on cases with diagnosed active tubercu- 
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Table 1 
Probabilities of Quit Response Given by Each of the 
Items in the Refined Form of the Index 
= OO 
Proba- 
Chi bility of 
square Cutting quit 
Item N p points response 
eRT e e e S a 
Service-connected 360 001 yes -15 2 
disability no 53 
History of The 348 .001 first onset 51* 
chronic case 75 
Duration of illness 332 001 <2months AL 
>2mo. <2yr. .60 
>2yr.<Syr. .64 
>Syr. 79 
Previous hospi- 340 .001 none .43* 
talization lor2 63 
>2 85 
Previous discharges 332 .001 none .57* 
all regular At 
all irregular 88 
mixed 64 
Residence 363 .05 same city 57* 
other 68 
Previous psychi- 352 .001 no 58" 
atric diagnoses yes 83 
Occupation 333 .01 unemployed 83 
laborer 64 
student 27 
other physical S 


other mental 
3, ry e 


Score given in such instances 
of that item, which is indicated here by an asterisk. 


No predictions were made for cases that 
fell between the scores 15.7 and 16.5 (49 per 
cent of sample). It should be noted, howevel 
that the index was devised not to predict all 
cases on admission but to select homogeneous 
samples from the total group. When used in 
this way, with cutoff Points of 15.7 and 16.5; 
the index yielded a contingency coefficient of 
48,’ < .001, on the cross-validation sample.” 


losis. This eliminates the miscellany of administra- 
tive regular ischarges that are not classified here 25 


Predicted sample, 


| 


a 


STAY- RESPONSES — 
QUIT- RESPONSES ---- 


PER CENT OF CASES 
© 


125 130 135 


INDEX 


Fig re 
1. Distribution of scores for stay-response casi 


The The Revised Index 
y oa form of the index was achieved 
1949_19 re the discharges in all five years, 
Nation 3. On cross validation the discrimi- 
Mained ney of all but the “age” item Te: 
Were sia seein Scores on the final form 
exactly rived from the remaining eight items 
Viduay 2S, it the original form. The indi- 
are giy, Probabilities furnished by each item 
e en in Table 1. 
Shown „Scores of each group distr 
e T Figure 1, 
tion fey of this index, i.e, the correla- 
Clearly peen scores and stay or quit responses, 
U the į pends on the cutting points selected. 
edictions 
ight be 


jbute as 


higher vali may be selected “that yield 
al one For example, cutting points 
ig Cases and > 14.1 isolate 79 Pe cent of 
er Mogeneit nd yield a C = 50, 2< 001. If 
mphz city rather than size of sample is 


asi. 
zed, cutting points of < 13. 


SCORES 
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(nlm wn enee dt 


aes) 


14:0 


es and quit-response cases on the revised index. 
> 14.5 isolate 40 per cent of all cases with 
last cutting points, 


C=.59, P < .001. The 
isolate 39 cases with 8.5 chances 


onse and 103 cases with 8.8 


Discussion 


By means of this index, samples of a given 
size and with a given probability of stay or 
quit response may be selected from the popu- 
he hospital under study. This 
m of the present study. 
Generalization of these results to other 
hospitals must, of course, await 
i ies. However, & recent 
(2), con- 


hospital, suggests some likeli- 
lized nature of these rela- 


Speth also cO i h 
in an effort to differentiate regular discharge 


from irregular discharge tuberculous patients. 
As in the present study, age, Tace, religion, 
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number of dependents, and marital status 
were found not significant. Also in agreement 
with the present findings, service connection, 
length of illness, and previous irregular dis- 
charge were found to differentiate the groups. 

The immediate value of this index is seen 
as a device for the economical preselection of 
Stratified samples for intensive study during 
the course of hospitalization. It also may be 
applied to advantage in Studies of irregular 
discharge that are designed to evaluate the 
effects of experimental intervention, in that 
within-group variance may be reduced by 
using groups stratified in terms of probable 
final discharge. 

The predictive efficiency of these simple 
demographic data serves to emphasize the im- 
portance of variables other than Personality 
traits as correlates of final response to hos- 
Pitalization. As noted earlier, objective situa- 
tions, both within and without the hospital, 
may vary greatly 
Systematization of 


liminary to the study of adaptability to pro- 
longed hospitalization. 


Summary 
About half of al 


of (a) criterion for selection of subjects, (b) 
techniques of sampling, and (c) isolation of 
relevant extra-personality variables. A crite- 
rion for final response to hospitalization 15 
specified and an index derived from demo- 
graphic data that may be used to predict the 
final response of select samples. On cross 
validation, this index yields a C of .48, ? 
< .001, between score and final response for 
the predicted samples. A refined form of this 
index is then described and its application 
as a technique for stratifying samples for 
intensive study or for evaluating effects of 
experimental intervention is discussed. 
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Results of Treatment of Enuresis by a Conditioned 
Response Méthod 


Barclay Martin and 


Delores Kubly 


University of Wisconsin 


Several i g 
ean e investigators have reported using 
the treatmen techniques with great success in 
ae gy enuresis. Mowrer and Mowrer 
irteen year O children between three and 
Ported that ip age by this method and re- 
our to eight were cured of enuresis within 
Successful] weeks. Morgan and Witmer (2) 
enuretics Bog four out of five chronic 
adder tr he fifth was discovered to have 
Ment. Da ea that required medical treat- 
chronic a son and Douglass (1) treated 20 
‘eported i. retics, ages six to thirteen, an 
improved to be cured and 5 to be greatly 
pe, (not more than one wet bed per 
hes P 
ure ii certainly suggest that this pro- 
© sampl y efficacious in stopping enuresis. 
Small, and es used, however, were relatively 
Sults on | there is a need for additional re- 
Senera] pr numbers of children before the 
assessed s süvenes of the method can be 
Owing s was toward this end that the fol- 
a were obtained. 


Procedure 


The ; 

questig formation was obtained by means of 
ch dr lonnaire filled out b ts whose 
With 2 bad b out by paren 
Wi ha condi zeen. treated for enuresis at home 
ts te sent ape apparatus. Questionnaires 
1g mercially all people who had bought this 
Aa and Jul sold apparatus between January 
h © put «A 1953.7 Respondents were asked 

Mider to sen ir names on the questionnaire 
e ure anonymity. 
Mesh «pp paratus feat coriis of two wire 


foil 
to The pads” separated by @ piece of 
St auth j f 
tion’ ealth G wish to express their appreciation 
is — Corporation for its coopera- 
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cloth. When the circuit between the foil pads 
is completed as a result of urination, a buzzer 
sounds and the child is awakened. In terms of 
conditioning theory, bladder tension is the 
conditioned stimulus, the buzzer is the un- 
conditioned stimulus, and waking up is the 
response that is to be associated with bladder 


tension. As time goes by, it is also hoped that 


the somewhat more temporally removed re- 


sponse of sphincter control will become as- 
bladder tension, thus allowing 


sociated with 

the child to sleep through the night dry. 
Parents who buy this equipment are te- 

quested to consult a physician before using it 

in order to tule out organic factors. 


Results 


One hundred and eighteen questionnaires 
were returned out of the 220 that had been 
sent out. Part of the information thus ob- 
tained is tabulated in Table 1. The four 
points on the improvement rating scale are 


defined as follows: 


Cure: Three recurrences OF less since the end of 


treatment. 
Marked impro 


per month, or inte! 


relapse 
Failure: Unqualifi 


e important results can be sum- 


ed negative reply. 


The mor 


marized as follows: 
1. When the Cure and Marked Improve- 


ment categories are combined, the treatment 
is found to be relatively successful in 74% 


of the reported cases. This figure must be 
accepted with some caution since it is not 


unreasonable to assume that among the 102 
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Table 1 


Results of Enuresis Treatment 


Improvement rating 


Marked Temporary : Tol 

Cure improvement improvement Failure M 

o 

Group N % N % N % N % N 7 

118* 1 

66* 56 21 18 14* 12 17 14 100 

mae 42 53 i 17 1 14 13 16 R 100 
Females 21 60 8 23 2 6 4 11 


* The N of 118 includes four Ss for whom sex was not reported. 


cases who did not return the questionnaire, 
there may be a higher percentage of negative 
results. Respondents, however, were told in an 
accompanying letter that the investigators 


were just as interested in negative as positive 
results. \ 


2. There is a significant difference between 
the sexes in terms of the occurrence of enu- 
resis. Boys make up 69% of the 114 cases in 
which the sex was reported, and the proba- 
bility of a chance deviation from 50% is less 
than .01. This finding is consistent with previ- 
ous findings (1, 4), 

Seventy per cent of 
Cure or Marked Im 
compared with 83 


the boys were in the 


significance, 


3. The average age of the children was 9,3 
years with no significant sex differences, The 
ages ranged from 3.5 to 18.5 years. Improve- 
ment was not associated with age. 

4. The average lengt 
about six weeks. For bo 
weeks and for girls the 
with a difference that 
significance. The grea 
sis in boys, and the te 
a higher percentage 
rence and to be trea 
of time, suggest that 


h of treatment was 
ys the average was 6.7 
average was 4.1 weeks, 
Teaches the .02 level of 
ter frequency of enure- 
ndency for girls to show 
of cures without recur- 
ted for a shorter period 
in general girls are less 


susceptible to enuresis and are somewhat 
more easily cured. 

5. For the cases in the Cure and Marked 
Improvement categories, an average time å 
14.5 months had elapsed since termination 
treatment. There were no significant sex ® 
ferences. " 

6. The children had had enuresis for Fi 
average of six years before this treat 
There were no significant sex differenc E 
Eighty-seven per cent of the children we 
reported to have been bed wetters since bii 
The children were considered to have 
enuresis only after the age of three. 


Discussion 


These results must be considered as roug” 
approximations. The questionnaire appre 
Prevents one from applying exactly sn 
Procedures to all subjects and, in alain 
one must rely upon the memory of the paren! 5 
Also, there is no control group of enuretiC 
that would take into account “spontaneous” 
cures. In spite of these shortcomings, the T A 
sults indicate that this procedure is effectiv i 
in stopping enuresis in a substantial numbe 
of cases. s 

Conditioning or habit training proceduré® 
are frequently referred to by clinicians É 
being merely “symptomatic,” with the imp A 
cation that really successful and lasting cur 
for symptoms such as enuresis can only E 
achieved by more intensive therapeutic 4 
tention to underlying personality disturbance®: 
In the case of enuresis the present wiley 
Would like to suggest the following viewpol?™ 


a I IMO a 
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pare is no sharp dichotomy between children 
By ot ee enuresis is a rather isolated habit in 
child: erwise well-adjusted personality and 
ton TF for whom enuresis is one manifesta- 
a deep-seated anxiety and seriously dis- 
famil interpersonal relations, usually in the 
scene context. The alternatives probably 
the Sent extremes on a dimension. The greater 
enur investment that the child has in the 
a o as an interpersonal expression—for 
tilit; ple, as a passive way of expressing hos- 
Mo defiance toward the parents—the 
cedure ely is it that the habit training pro- 
of is. will be effective. However, the results 
er of study suggest that a substantial num- 
turbed enuretics are not so emotionally dis- 
tive, as to render these procedures ineffec- 
ee it would be wise for parents to 
as Ene psychological evaluation of the child 

ney physical examination before using 

Conditioning apparatus. 


Summary 


The results of treating enuresis by a con- 
ditioned response method are reported in this 
study. It was found from questionnaire re- 
sponses by parents of 118 children that this 
procedure was relatively successful in 74% of 
the cases. Girls were found to have enuresis 
less frequently, and to be somewhat more 
easily cured when they did have it. 


Received May 24, 1954. 
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MMPI Responses of Patients with Multiple Sclerosis’ 


Franklin C. Shontz 
Highland View Hospital, Cleveland, Ohio 


In the present research, the Minnesota 
Multiphasic Personality Inventory was ad- 
ministered to a group of sixteen patients hos- 
pitalized for multiple sclerosis and to a group 
of sixteen patients hospitalized at the same 
institution for chronic illnesses other than 
multiple sclerosis. The groups were matched 
(by groups) for chronological age, and the 
average MMPI profiles for both samples were 
compared with each other and with the re- 
sults reported by Canter (1) in a previous 
research, 

Significant differences were found between 
the three samples (Canter’s “MS” group, and 
the present “MS” and “Other Chronic Ill- 
nesses” groups) only with respect to the Hs, 
Hy, D, and (?) variables. On both the Hs 
and Hy scales, the three groups could be 
ranked in descending order as follows: 

1. MS group from Canter’s research, 

2. MS group from present research. 


3. Other Chronic Illnesses group from pres- 
ent research, 


score than Canter’s subjects, 
value was not significantly 


1An extended Teport of this stud 
tained without charge from Franklin 
Highland View Hospital, Cleveland 22, 
a fee from the Ameri 
To obtain it fro 


C. Shontz, 
Ohio, or for 


74 


that of the Other Chronic Illnesses group 1 
this research. Finally, the present MS pa- 
tients were also found to produce more (?) 
Tesponses than the Other Chronic Illnesses 
group, although differences in the adminis- 
tration of this scale made cross-study com- 
parison impossible. x 

In short, the present sample of patients 
with multiple sclerosis could be differentiated 
from a sample of patients with other citoni 
illnesses by the evidence of higher levels 0 
self-concern, body anxiety, and uncertainty 
of response in the former group. Both samples 
obtained about equal D scale scores. r 

Despite the occurrence of certain differ- 
ences, the average MMPI profile for the pres- 
ent MS group was found to be very similar 1 
form to that obtained by Canter. The lowe! 
values which were obtained in this research 
on the Hs, D and Hy scales may probably be 
attributed to the higher mean age and longer 
duration of illness of the patients in the pres- 
ent study (implying more adaptation to the 
disease process itself) and to the fact that 
many of the patients used in this research 
have been permanently hospitalized for some 
time and therefore exist in a relatively secure 
and nonfrustrating environment. 

The ambiguity of the disease process itself 
is held to account for the higher level of (?) 
responses for certain individuals in the pres- 
ently tested group of patients with multiple 
sclerosis. 
Brief Report 
Received November 1, 1954. 
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Arbuckle 

ie ag S. Student personnel services in 
1953, P ucation. New York: McGraw-Hill, 
Tn additi p. x + 352. $4.75. : 
cussion of ion to the content usually found in a dis- 
entation, | aa services, such as admission, ori- 
housing, ihe sd activities, health, student aid, and 
g and religi uthor has included chapters on teach- 
| faculty ian services, The book is addressed to 
tea Pedantic E aes and is written in an inviting, 
t ching Brett e. The chapters on counseling and 
cen Porary ide t a good summary of the basic con- 
fared Eo aa Ka, these processes in a student- 
ies Ulties would ork. If a good percentage of our 
tribution t read and react to these ideas, a real 

ine the ae higher education would be made. 
eee ions ers on counseling and teaching that 
n in the Rela. closest to solving a common prob- 
aa Seman a pami not to lose sight of the dy- 
whi his develo hen discussing services well planned 
of ct include pment. The 74 pages of appendices, 
pe tsonnel Serer blanks and specific illustrations 
better al Sota in practice, will be helpful to 
e a Coverage in the field. The reviewer feels & 
ang ;*chieved sa the periodic literature could have 
Mtegrated ithout distracting from the readable 
nature of the volume—F. McK. 


Bey, 

ak, 

ee 

and whe ctr The Thematic Apperception Test 
se. New oe Apperception Test in clinica 
+ 282. $6 = Grune & Stratton, 1954 Pp. 3 


Ret this clini 
fate ate manual for the TAT and CAT; 
leon, reting ShA his techniques for recording 20 
1952 ere (see ich have been presented more priefly 
Shor, 15 ‘sae . consult. Psychol., 14, 161; 
leans „SUMmari 1983, 17, 156). Although D 
M py, Most face of other approaches; the 
senting ae on his TAT blank, which is used 
e longer illustrative cases. An analo- 


y the Editor 
jdentified by 


The 

e review: 

S Advi; s were prepared b; 
initials o7 Editors, who may be 


75 


gous form is used in the interpretation of the CAT 
protocols. References to completed research are 
minimal, but there is a short chapter outlining needed 
studies. Because the informal richness of the picture- 
method is best 
examples analyzed from varying 
ill be instructive for 
dents. It is probably not, in itself, @ sufficient text- 


book in projective methods.—+- 


Brand, Howard. (Ed.) The study of personality: a 
Wiley, 1954. Pp. 


book of readings. New York: 


a well-constructed in- 
diverse but all 
of relevant read- 
i The 


Brand’s book 
structional tool. 
are characterized by a high 
ability ; there is hardly & 


itor has supplied integration 
and by brief notes 


e book will be useful for in- 


structors who like their students ; 
discuss. It will be less helpful to 


present 2 systematically organize! 


rigant. Science and m 
Philosophical Library; 


theory —L. F. S. 


Burrow, T an’s behavior. New 
York: 1953. Pp. xii +564. 


$6.00. 
receiving training in both medicine and psy- 


chology, Burrow ecame interested in the psycho- 
i and participated in the introduc- 
eychoanalysis in America. Despite the in- 
phasis of his training, he felt that an 
t of view, which included a concern 
ent characteristics of mankind as a 
for the proper under- 
Burrow presented his 
a number of eminent 
scientists and the present volume is inspired by this 
correspondence. Unfortunately Burrow suffered & 
fatal illness in 1950, and the present volume is an 
integration and a completion of his work prepared 
by a close associate, William E. Galt. The volume, 
which cuts across many disciplines, shows 2 con- 
tinuous concern with some of the destructive fea- 
tures of man’s group behavior. In its effort to get 


f human behavior. 


f 


f 
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the reader to view mankind with a detachment which results, Des 
the reader’s individual Past scarcely Permits, the work, 
work is most provocative. Although the reader is 
certain to be most sympathetic with Burrow’s con- 
cern for the fate of man, and respectful of the scope 
of his scholarly allusions, he is likely to find the 
reading unusually difficult. In anticipation of this, a 


latter portions of the monograph include an inter- 
Pretive summary of findings, suggestions for schools 
and agencies, and an appendix which includes a sum- 
mary and discussion of the records of several indi- 
viduals from each of the age groupings—J. R. W. 


-it is the automatic tendency of the student Gruenberg, Sidonie Matsner, (Ed.) The encyclopedia 


confronted with the Principles of Phylobiology to of child care and guidance. Garden City, N. Y.: 
shy away from them, and in Support of his irresolute Doubleday, 1954, Pp. 1016. $7.50. 3 
policy to indict my formulations as being obscure The Encyclopedia of Child Care and Guidance is 
and unacceptable. . . ” The author provides his ir- 


: a comprehensive encyclopedi ing the whole 
resolute reader with a ten-page glossary offering not p ve encyclopedia covering 


parative pa- well edited and has excellent cross indexing so ne 
thology of the neuroses. New York: Interna- all information on a special topic is clearly indicate 
tional Universities Press, 1954. Pp. 263. $4.50, and easily found. The 


i are 
“This book is being written for advanced ioh add a light, human touch to the book, There 


7 > by specialists in their areas. The articles are readable; 
c y S : i s 5 
ae wea ie oe simply written in nontechnical language, and reas 
ement in Psychoanalysis, one era suring to parents. The reviewer has mixed feela 
i i and great ex- While the book is very suggestive and helpful, 


deal rather simply, systemati- ing of daily situations, But it is not so valuable i 
i; logy in strict it increases “seļf diagnosis” and allays fears so tha 
e gospel of Freud. Even com. there is a delay in getting professional help when 
fined in a ePted terms and concepts are de- needed. The Encyclopedia of Child Care and Guid- 
ned in elementary inth chapter epito- ance should, however, prove useful for all thos¢ 
in the previous eist, j ial summarized Working with parents and families. It is coriprereai 
the “comparati ght. Only in the Jast Page or two is sive and complete in its coverage, and the practica 
Parative ere it not for suggestions should be helpful in meeting each day's 

at the outset, Problems—B, M., Z 


f Psychoanalysis. Much of the Jones, Marshall R, (Ed. 
1 f ies in the great number of short motivation: 1954. 
illustrative samples ‘ e obviously Ser Current Theo 
tience of the author, — yy. K. Lincoln, Nebr.: 


P Pp. x + 322. Cloth, 5i 
i > Harrison, Ross; Tai oth, $3.50. Paper, $3.00, 
Elisabeth ; Machover, Karen; & Stee Mee This is the secon 


No. 53 (issued, 1953). Pp. 3 
This study of the 


atig imaginative thought, Benb itchi logical 
i group appli > “enbow Ritchie on the logii 
the Thematic Apperception Test, Pp ation of laws of Motivation, Leon Festinger 


er for each i © integration is achieved; 

which they include discussions of the rete eae pul ie S attempted. There is Stat to be said 

ing and of the Personality qualities implied by the aia They and obviously a lot of it being 
I ing 


of it remains exciting—W. A. H. 


` New Books and Tests 77 


a H. E. Psychomotor aspects of mental disease. 
ambridge, Mass.: Harvard Univer. Press, 1954. 
Pp. xiv + 185. $3.50. 


ESN pie monograph, reporting the application of 
Bester reaction time, speed of tapping, and finger 
ance ait to patients of various degrees of disturb- 
tarded i to normal subjects. Schizophrenics were re- 
lated fae all functions, in degrees significantly re- 
eir practic severity of their disorders. The form of 
from th Pas learning curves did not, however, differ 
fered ee of normal persons. Psychoneurotics dif- 
of perio le from the normal controls either in level 
suggest ae or in learning functions. The data 
ifferentj at the schizophrenics are about as well 
many paad by these simple motor tests as by 
niques ‘Sapa more subtle and dynamic tech- 
We strivi e implications are thought provoking—are 
e opang too hard to be subtle and overlooking 
Obvious ?—Z. F. S. 


M: 

RAE Motivation and personality. New 

Clini : Harper, 1954. Pp. xiv + 411. $4.50. 
is aay Psychology, for which personality theory 
Which eoar] matter, could benefit from a book 
Professio; ectively fuses the humanistic aims of & 
a aa and the investigative and logical methods 
directs Ren Toward this ambitious target Maslow 
ìs lance in his collection of interesting pa- 
the tradi fails, but the failure is a spectacular one in 
With th ition of Don Quixote. While tilting fruitlessly 
ber qp € Windmill of “atomism,” he suggests a num- 
Vigorous yt ideas for thoughtful consideration and 
Startlin, further research, While revealing either 2 
Most all misconception or a frank distaste for al- 
ence, he that has passed so far for psychological sci- 
for the a affirms the respect and unselfish conser? 
he Perso; ignity of others that are fundamental to 
s Rinda aspect of the clinician’s labor. And i 
toes ms the role of theory in science, it 
Mpiri, CCP him from engaging in some creative 
Waly cêl work that pectepHbiltty presses back the 
“Ussione “TOtANce even as it violates his abstract dis- 
ttiguin of theory’s nature, For its brief reports of 
Ure, th  panvestigations and as humanistic litera- 
thee? Ook is a delight. As an articulate integra- 
the techni, © values underlying clinical practice “A 
it” knowlege of thought and inquiry that provide 
È YeDresent, ge necessary to implement these values, 
"Jog “S much more confusion than fusion— 


iagat 
J , à 
Nep ®. The construction of reality in the RL 


w p 
$6.00 York: Basic Books, 1954. Pp. xiii + 
ie ap 
“ x MM ìi $, % 
Are in polume is one more testimonial to Piaget's 


Org, 2 maki ; ity 
quettizing aag Observations and to his ingenuity iP 
Stion o Pd interpreting them. He here raises the 
of $S in p DOW the child comes to “know” his We 
4 Hay of attaining concepts of ere 

S, hs e, an i most 0: 
beha, ai d of causality. For they 
ed jects were his own children aS 


v Vics i 
SS. His Gring the first eighteen months of their 


Observations of their behavior were based 


partly on simple but well-controlled stimulus situa- 
tions (finding a hidden toy, for example), partly on 
spontaneous reactions (watching persons come and 
go, for example). Because of their painstaking and 
detailed character, these observations provide badly 
needed information regarding the stages of develop- 
ment in early infancy. One cannot help noting, how- 
ever, the absence of statements concerning needs, 
motives, or social situations. To many contemporary 
child psychologists, accustomed to interpreting early 
development in dynamic terms, this may seem 2 
serious shortcoming. To others, not committed to 2 
particular theoretical view, Piaget’s strict adherence 
to observable behavior may seem a refreshing change. 
No psychologist interested in behavior development 
can help being stimulated by the observations re- 
ported here. Many will also sense from Piaget’s con- 
ceptualization of his data a need for rethinking some 
of our dynamic hypotheses regarding infancy. — 


A. M. G. 


Rogers, Carl R., & Dymond, Rosalind F. (Eds.) Psy- 
chotherapy and personality change. Chicago: 
Univer. of Chicago Press, 1954. Pp. x +447. 


$6.00. ; 
Books about psychotherapy fall, by and large, into 
two classes: summations of dinical experience and 
general theoretical discussions. In either case, they 
vary considerably with respect to both sont 
and degree of relationship to evidence. This wor a 
product of the University of Chicago eal n ling 
Center staff, is, therefore, without precedent; it is a 
whole book of research studies in the therapeutic 
outcomes. Eleven chapters are de- 
ts of empirical investigations of a 
and two are concerned wither 
i alyses, methodologically unique in eir 
ing coe on quantified techniques and objective data. 
For its boldness of conception, the enterprise sad 
devotion to explicit knowledge that it reflects, ani 
its uniqueness as the only volume concerned entirely 
with empirical inquiries into the events of psycho- 
h z, Psychotherapy and Personality Change com- 
pete wide and attentive 


ect and deserves & u i 
jand E the lines, however, it constitutes 


jence. Between e c 
aia rustrations and difficulties attend- 


k in the f T 
eet research in this field. Lost cases, spoiled 


iplici i jables lurk 
, and a multiplicity of wild varia l 
ike pen in the background, raising questions 
pout the suitability of data and marring the pre- 
r e techniques of data analysis 


isi . Too, th d 
5 ivi cing or appropriate to many 


readers as they apparently did to the participants 
in this investigation. Finally, the edge of novelty 
> o have worn off the Chicago group's con- 
. The studies reported here bear a disap- 
ointing degree those published 
$ viously from this fertile source- One wonders if 
te concepts and pasic ideas of client-centered coun- 
seling are not in need of a revision now that they 
have served their stimulating purpose. But no ore 
else has done anything to challenge so wholesome y 

thinking about therapy, to provide sounder in- 
formation about what happens in the consulting 


controlled sort, 
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room, or to offer a more constructive model for 
those who would replace intuition with communi- 
cable knowledge—E. J. S. 


Stanton, Alfred H. & Schwartz, Morris S. The men- 
tal hospital. New York: Basic Books, 1954. Pp. 
xx + 492. $7.50. 

In this volume, social Psychology takes a pene- 
trating look at the structure and functioning of a 
mental hospital and comes forth with some insight- 
ful conclusions. The hospital, like other social insti- 
tutions, has both a formal structure shown by its 
organization chart and an informal structure through 
which communications really pass. In many respects, 
the problems resemble those of a business or a uni- 
versity—the perceptions and misperceptions of “the 
front office” by the lower echelons of staff provide 
an example. Other issues are unique to the hospital. 
The study considers the patients as active Partici- 
pants in the social organization, not merely as pas- 
sive recipients of the staff’s efforts. Of special inter- 
est is the evidence of an intimate relationship be- 
tween the staff’s morale and the patients’ behavior. 
The study deserves the attention of both clinical and 
social psychologists —L, ES, 


Taylor, William S. Notehand for 
Ed.) Northampton, 
College) : Author, 
21¢. 


psychologists. (3rd 
Mass. (15 Pierce Hall, Smith 
1954. Pp. 5 (mimeographed). 


easly Irnd. It 


New Books and Tests 


Tests 


Langmuir, Charles R. Oral Directions Test. Person- 


nel Tests for Industry, ODT, Form S. Adults in 
industry. 1 form. (15) min. Record, 12 in, 33 
r. p. m, or tape, 300 ft, 3.75 in./sec. ($12.00 
with manual, key, 100 answer sheets); answer 
sheet ($4.00 per 100); manual, pp. 8 (35¢): 
New York: Psychological Corp., 1954. 


A revised abbreviation of a test first published 12 
1946, the Oral Directions Test provides an apprais# 
of mental ability for industrial applicants that 
relatively independent of reading skill. Examing 
listen to a recording and mark an answer sheet t0 
show their comprehension of directions. Correcte 
split-half reliability is about .87; the test correlates 
85 with a conventional printed test. The man 
gives preliminary evidence of discriminating abov' 
average and below average workers in industry, ay 
Provides tentative norms based mainly on texi 
and pharmaceutical employees.—L. F, S. 


Manson, Morse P., & Ulett, George A. The Ror- 
schach Evalograph. Record and analysis blan 
for Rorschach, pp. 24 ($3.50 per 10; $7.00 pe 
25; $25.00 per 100). Beverly Hills, Calif. (B° 
775): Western Psychological Services, 1954- 

Perhaps the most elaborate Rorschach blank a 

far devised, the Evalograph Provides spaces for r 

cording, scoring, and tabulating responses, color 

printed miniature blots for locations, a summary 

and profile, and numerous aids to the examiner- t 

is an attractive and compulsively thorough prodi 

a dream record to end all records, but one me 

properly question its economy. The recording E 

scoring can probably be done as effectively on l y 

costly paper. The percentage table, the list of sy" 

bols, and the hints on scoring and interpretation Le 
long in a manual, not in an expendable blank. TH 


Evalograph is fun if you can afford it—L. F. S- 
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Mortimer M. Meyer and Ruth S. Tolman 
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T i 
he assumption has been 
f stories around 


ede the construction © 
material fr pictures, the individual organizes 
sion of peti’ his own experience. The expres- 
Material i sciously recognized autobiographical 
Puts it oe TAT stories, or, as Murray (8) 
autobio - ham aopn of “frank and unabashed 
Several es has been the subject of 
See ae One of the earliest was 

e TAT (9) comparison of the results of 
Other ie information obtained through 
autobiopranhh among them interviews and 
jected t phies. His esults were never sub- 
lurray o statistical treatment, but clearly 
tion, A them as satisfactory valida- 
ing ‘on rison (5) used the method of match- 
ory ss based on the TAT with case his- 
With m erial of the same individuals and met 
experiment than chance success. In another 
} SAE Harrison found that biographical 
2 mentally could be deduced from the stories 
Stee of y x ill patients with a fairly high de- 
dis iny alidity. Rotter (10) on the basis of 
‘the ean a indicates his finding that 
Ory ban figure” (the hero) has & his- 

sien aL {© the subject’s own. es 

ie (6) study of the relationship 
Ponse t stories told by 40 individuals in te- 
ast histe three of the TAT pictures and thei 
Of this fem revealed a more faithful reflection 
She fou istory in some pictures than in others. 
duent] nd that stories to Picture 1 most fre- 
$ e n esigi the actual history, especially 
ip eme of the story was a? aggressive 
ie Cots at the meeting of Western psychologi- 
954, ciation, Long Beach, California, May 20, 


79 


e Clinic, Los Angeles 


one. Tomkins (12), in reviewing Markmann’s 
findings, suggests that much work needs to be 
e conditions under which 
past histor 

Combs 
personal exp 
ographies found tha 
cent of TAT 
terial drawn fro 
perience. In terms 0 
encouraged the mos 
experience. 

Now in all these studies 
by Bell (1, pp- 2 
1 on the subject’s attitudes toward or 
experiences with the parents oF with parental 
figures, put little or nothing in regard to the 
attitudes which the subject attributed to these 
figures. In this same Way, Bellak’s (2) outline 
for analysis Or interpretation of the TAT in- 
cludes a section on “Attitudes to Superior 
(Parental) Figures or to Society”; but again 
these refer to the subject’s attitudes, not to 
those ascribed to parental figures. An unpub- 
lished Ph.D. dissertation by Butler (3), “Par- 
ent Figures in TAT Records of Children in 
Disparate Family Situations,” may deal with 
some aspects of this question for children, but 
does not touch on the situation for adults. 

There are two recent studies, Mitchell’s (7) 
and Singer’s (11), which do involve attitudes 
ascribed to parents. Both use the TAT and 
both assume that the TAT stories correctly 
represent the subject’s feelings about his par- 
ents’ attitudes toward him. These studies are 
concerned primarily with familial attitudes 


, and in others re- 


ported 07-252), there is 


materia! 
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expressed in stories to TAT cards in relation 
to socioeconomic status. 


Hypotheses 


It was the purpose of this study to explore 
specifically the correspondence between char- 
acteristics attributed to parents in TAT stories 
and in therapeutic interviews. The charac- 
teristics investigated were of two kinds: (a) 
attitudes toward the subject or patient which 
were ascribed to the parents; and (b) gen- 
eral descriptive images or Pictures in which 
the subject has depicted the parental figures. 

Using TAT stories and the content of 
therapeutic interviews of patients in a mental 
hygiene clinic, we attempted to test three 
hypotheses: 

1. Patients who tell TAT Stories involving 
attitudes ascribed to Parents or images of 
parental figures will also in therapeutic inter- 
views discuss attitudes which they ascribe to 
their own parents or i 


date of testing, 
3. The kind of 


sion in our data. i 
aspects of TAT material such a. 
conscious fantasy would not be r 


Method 


The materials examined in th 
from the files of 


S Teversals of 
€vealed. 


is study came 
50 patients in the Mental 


Mortimer M. Meyer and Ruth S. Tolman 


Hygiene Clinic of the Veterans alll 
in Los Angeles. These materials were: iz 
1. TAT stories in response to Cards eis 
6 BM, 7 BM, 7 GF, and 18 GF—those a 
in which figures appear which are the É 
easily identifed or interpreted as pare 
ones; and h 
2. Records of ten therapeutic intervin 
which in most instances were the first 
interviews of therapy. i far 
In order to avoid biased sampling a in 
as possible, the file of every patient test 
the year 1948 was examined <a ‘coi 
and every file which met the criteria 0 PM 
taining the TAT and also the records 0 pe 
therapeutic interviews around the veg B, 
riod was included. Since the year 1948 di ing 
provide 50 cases, the files of the foon 
year were examined in the same way unti rds 
such records were obtained. The 50 ae 
used included 33 of males and 17 of fenai F 
Tt should also be noted that the specific c | 
used in the testing varied according to abe 
judgment of the examiner; hence not all E- 
jects were presented with each of the oa 
included in the study. Cards 1, 2, 6 BM, 
7 BM were used most frequently. le of 
On the basis of a review of a samp a 
TAT stories and therapeutic interviews Ee 
patients not used in the study, a check $ b 
was devised to include the 12 attitudes Ke 
Which these patients characterized pare 
figures in the stories and in therapy se! i 
The sheet provided a separate check list a 
each parent, Thus, it could be indicated ee 
in the story in response to TAT Card 1, 


Be ted 
example, a dominating attitude was attribut 
to the father, 


a solicitous at 
mother, etc, 
used to note 


or that in response to 6 ie 
titude was attributed to as 
An identical check sheet ce 
the attitude mentioned dur} é 
therapy Sessions, and on this sheet the inte 
views (from 1 to 10) were indicated. 


S 
The attitudes included on the check sheet 
were as follows: 


è Comforting, giving, affectionate 

N Solicitous, concerned 

- Advice giving 

- Indifferent 

$ Excessively attached 
Over-giving 

í Dependent 

Self-centered 


CPN ANRWNH 
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9. i 3 
Demanding (includes nagging; to get things 


a nee the parent) 
ominating, authoritative, wants to control 
J direct l 
G E punishing 

jecting, critical, obstructing, disapproving. 


In 
in ae same manner a check list of images 
BTS dési parental figures were depicted was 
esigned. These were: 


A S adie; good, appetizing 
a S effective 
A mpetent, ineffective 
ae » evil, unattractive 
iction between parents. 


Si 
Ts the check list included a total of 17 

An 
a TA a stories and the ten therapeutic 
Vestigators ere then analyzed by the two m- 
Presence of together.* Every time that the 
or each T. A attitude or an image in stories 
view was T card or in each therapy inter- 
Pertinent pea the item was marked on the 
© whom a list in relation to the parent 
Was 1 a eee If no attitude or image 
n int avin eina story on a TAT card or m 
fact w, this fact was indicated. The 
analyzed ies and therapeutic interviews were 
i independently, without knowledge of 


Ich stori 
0; : : : : 
erviews, ries were associated with which M- 


Th Results 


e 

three data were analyzed to answer the 
questions raised. 

Do x : 

Predictig TAT stories serve as & basis for 
Scuss n as to whether or not patients who 

test i attitudes and images in the 
c a a them also in therapy sessions? 

řesults į are analysis yielded no S 

In regard to: 


athers 
ene 
obero tudes 


ignificant 


Th k images. 
er 3 

furnished nes indicated clearly that the TAT 
lon, no basis for prediction in this situa- 


2 
A 

Wa, Sam 

der nalyzed si ten cases involving 330 judgments 
CENG obtain » the investigators separately in or- 
84 5 of reliabilt measure of reliability. Phi coeffi- 
er the t ility were 54 for TAT protocols and 
“Bn herapy sessions. Both of these values 


fic; 
ant considerably beyond the 001 level. 


; 2. Do the attitudes ascribed to each parent 
in the TAT resemble those expressed in the 
therapy sessions? Analysis* of the data gave 
the following results: 


1. In relation to fathers’ attitudes, only six rec- 
ords out of the 50 had any item in common in the 
TAT and therapy; none had more than one item. 
Of the six records, only three could be interpreted 
as challenging the null hypothesis at a level of con- 
fidence between 5 and 10 per cent. 

2. In regard to mothers’ attitudes, 15 of the 50 
records had one item jn common and one had two 
in common. Only the latter could be interpreted as 
challenging the null hypothesis at a level of con- 


fidence between 5 and 10 per cent. 
Hence, the results indicated that the kind of atti- 


tudes as related to parents in TAT stories furnished 
no basis for prediction of those that were ascribed 


to them in therapy sessions. 

3, Do the images of parents as noted in 
TAT stories correspond to those expressed 
in therapy? Analysis of the data in answer 
to this question gave the following results: 


1, In relation to fathers’ images, only five records 
out of the 50 had any item in common, only one of 


none more than one, 

level of significance. 

data bearing on all 

three of our inquiries corroborated a null 
ociation between 


hypothesis of little or no ass 
TAT and material in the 


common, 
even a 10 per cent 


Thus, analysis of the 


at one explanation of 
f association might result 


exclusive to P' 
the investigators. To exp! 


the items On 
zo groups, ON 


trarily into tw e i 
“positive” or favorable attitudes and images, 
the other “negative” or unfavorable ones. 

3A combinatorial analysis employing the follow- 
in formula, suggest Dr. Joseph Gengerelli, was 


applied to the data: 
M-N) | |C 
C ea ae 
i E Ne 
Cy.+Ne N+M 
f possible choices, Na = 


= total number © 
i +, TAT, Neo= unique choices in 


and Ne = choices in common. 


M—(Ne+No) 
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This procedure, however, resulted in only a 
negligible increase in predictive value. 

In the course of this dichotomized type of 
analysis, an interesting trend was noted. It 
was observed that some patients ascribed 
both positive and negative attitudes to the 
same parent. For example, a father would be 
described as “comforting and giving” at one 
point, and as “rejecting” or “dominating” at 
another. This “ambivalence,” as we called it, 
occurred both in TAT stories and in thera- 
peutic interviews in relation to both parents, 
However, in both the TAT and in therapy 
sessions the ambivalence expressed in regard 
to mother figures was Significantly 4 greater 
than that in relation to fathers. This finding is 
consistent with many writings which have 
Suggested that in our culture the relationship 
with the mother is the more complex and the 
more important in emotional illness. 


Discussion 


In interpreting the negative findings re- 
ported in this study, two considerations should 
be taken into account. 

In the first 


tions discussed, 
In the 


that there is a 


Pictures eyok 


in the TAT i 
vestigating this 


* Critical ratio of 


difference between Proportions 
in TAT stories, 2.4 


; in therapy sessions, 3.2, 


Mortimer M. Meyer and Ruth S. Tolman 


Summary 


In this study relationships between parental 
attitudes and images expressed by patien Sa 
TAT cards and in psychotherapy M 
vestigated. F indings suggest no predictabi r, 
from TAT to therapy as to whether or an 
Parents were discussed. When they di: 
cussed, no similarity was found between É 
attitudes and images given in TAT stories na 
in psychotherapy. Ambivalent attitudes ia 
ward both parents were present, but Sls 
nificantly more often toward mothers. 
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ale . s 
he Application of a Psychometric Scoring Procedure 


to a Group Modification 


of the Thematic 


Apperception Test (N-TAT)’ 


Leonard D. Eron, Florence Sultan, and Frank Auld, Jr. 


Yale University 


Thi 
AES gee reports an extension of a psy- 
Worked o scoring procedure (3), which was 
are ut with the standard TAT method, 
TAT re ie used by the Navy. The Navy 
(1) in AT) has been described by Briggs 
a previous report. 


Subjects and Procedure 


The sub; 
Chosen rn for this study were 100 sailors 
«$; New ematically from two classes at the 
don, Con y Submarine School at New Lon- 
every oT Spo The N-TAT protocol of 
Tom the Glen n in these classes was drawn 
tained Sen until a sample of 100 had been 
ears to b ecause the method of selection ap- 
troup of pa aga. we can assume that the 
atine sch 00 is representative of all sub- 

he N. ool entrants. 

Written aT protocol consists of 10 stories 
ifferent pies on each page of which is 
ares ate ali agate picture. Seven of the pic- 
rd editi ight modifications of the standard 
male Boe oh series (8) and three are origi- 
$ the purposes of this study, after 


Thi 
R IS sti 
tion och, the, was supported by the Office of Naval 
Psyc and by mea the American Council on duca- 
nee itty. The Foundations Fund for Research in 
Nays tilly Se conclusions reported here do not 
Duffin, Pank: ect the official opinion of the 
Coop; er of a are extended to Commander J 
epon man S. Naval Submarine Base for his 
e ac support. 

a3 plates were reproduced in the earlier 

. “The are identified for our purposes 85 
Hon ce Min Operation,” 8 BM in the 3rd edi- 
‘Cn Pathe eee Gan BM in i 

Ptain’ -Son,” P 
« fa" age Mast,” Aen 
iMoming Apted from 19 in oot gad etition 
p fter,” 13 MF in the 3r : 


lation,” 
ion,” adapted from 14 in the 3rd edis 


\ 


66DA 


tig 1S 4 
$ gait’ of 89 sbetweeh two ra 


Seyen -and thg gyae 


a „tign. 


each page of each booklet had been assigned 
an identifying number, the booklets were 
taken apart so that all stories for any given 
picture could be analyzed at the same time. 

Each story was analyzed for the following 
variables: emotional tone, outcome, themes, 
perceptual distortions, unusua 


acteristics, and Jevel of interpretation. All the 
iable at 


stories were analyzed for a single varii 

a time and scoring on one variable was com- 
pleted for 100 stories before proceeding to 
the scoring of the next variable. Once such 
an analysis it was possible 
to compile both apperceptive and thematic 
norms (cf. Rosenzweig, 10), since the same 
scheme can be used for each picture and the 
scores on one picture are comparable to the 
scores ON each of the other pictures. The re- 
liability of the scoring scheme was tested by 
having two judges (Eron and Sultan) inde- 
20 stories for each picture 
al of 200 stories for all 10 pictures). 


s of the reliability study are reported 


below in connection W discussion of 


each variable. 
Results and Discussion 


Emotional tone. In the analysis of the emo- 
tional tone of the stories, & set of five-point 
scales empirically derived for the standard 
set of pictures was utilized (6). Since three 
of the pictures are origina with the N-TAT, 


the specific_s¢ “Be used for only 
rth anging scale for emo- 


nde was usqh fo the others. A Pearson 
ters; on 200 stories 


yy vs 
8: “Ppicktip,” orginal...“ Rereyasion! 4 in 
fhe 3rd edition. 10. “Seabag,” oni al. 

N sian ae a 


oe 


\ ae Oe 
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Leonard D. Eron, Florence Sultan, and Frank Auld, Jr. 


Table 1 


Percentage Frequency of Stories of Various Emo 


tional-Tone Categories for Each of the 


TAT Pictures in the Navy Series 


Emotional-tone rating 
eae =ð = 0 +1 5g Reject 
10(13.3)* 79 (40.0) 5( 9.3) 6(37.3) 
$ s 0.0) 24(26.7) 41 (48.0) 33 (24.0) 0.0(1.3) 2(0.0) 
3 2( 5.3) 49(58.7) 33 (32.0) 14( 4.0) 
4 1 92 2 5 10(2.7) 
5 3( 9,3) 61 (33.3) 23 (14.7) 3(33.3) 0.0(6.7) 1(0.0) 
6 12(45.3) 70 (49.3) 11( 5.3) 6( 0.0) 4 
7 8( 9.3) 70 (18.7) 10(45.3) 12(22.7) 0.0(4.0) 1 
8 61 32 6 2(0.0) 
9 4( 4.0) 81(94.7) 7( 1.3) 6( 0.0) A 
10 6 17 73 3 


* Figures in parenthe: 


compares favorably with the reliability esti- 
mates obtained in other investigations using 
these scales with male and female college stu- 
dents (r= 86) (6) and adolescent girls 
esents the emo- 
for stories written by 100 


to each of the 10 N-TAT 
pictures. 


For purposes of comparison, 
ings in each emoti 
tributed in 


th College si 


) the college 
nd fewer — 1 stories. 


series, designed to make the sti 


submarine in distress, 


wife is equally as 
theme of remorse after intercourse 


ses refer to percentage frequency in original standardization group (3). 


is may 
the sailors the latter is the modal theme. This m 
reflect a personality difference in the two & more 
For picture 7 (Contemplation) the sailors have ea 
— 1 stories and the college group more o ie pic- 
This may be a function of the alteration in a to 2 
ture—from a figure looking out of a window 
sailor leaning over a rail. 


of 
Table 2 presents thematic norms for a 
tional tone—the percentage of subjects nis 
have a given number of stories of each mE, 
tional-tone rating in a series of 10 sto i 
There is no real basis for comparison ‘te 
thematic norms previously compiled in Ei 2 
Sroups, since they have been based on ah js 
pictures in the standard series. However, Í i 
obvious that, just as in the individually 4 


Table 2 


a 
quency of Individuals Who mev 
umber of Stories of Each Emotiona! 


Percentage Fre 
Given N 


Tone Category in a Total of Ten Stories 
Given in Response to the Navy TAT 
Emotional-tone rating 
No. of ? 
ey MA Sa +2 Reject X 
94 
0 67 A E 3 99 mage 
1 E DY Meh E E 2 
2 5 27) 32 1 
3 22 tee 10 
3 SLET SA 
18 2 2 
6 31 1 
i 26 
iG? Rey 
9 3 


| 
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ministered TAT, these pictures too elicit pre- 
dominantly sad stories. 

Outcome. A set of five-point scales em- 
Pirically derived on the standard series of pic- 
tures in another investigation (3) was used 
in the analysis of outcomes. The inter-inter- 
Preter reliability derived from the independ- 
a ratings of 200 randomly selected stories 

y two judges was .81 (Pearson 7), which 
compares favorably with reliabilities obtained 
in three other studies (3, 4, 7). It was neces- 
H to add an additional category, X, to the 
a e to cover those stories in which there was 
a a any outcome. In the individual 
an inistration it is always possible to ask for 

Outcome when the subject fails to give one- 
Ents: of course, impossible in a group ad- 
give ration. Thus only when the subject 
Write alternative outcomes or specifically 
Sco es that he cannot make one UP is he 

iia with a ? outcome in this procedure. 
is te if there is no definite outcome, bp 
a, X. Consequently, in this group ° 
as + the largest category for any story 
Zation | and a comparison with the standardi- 
Come group is not valid. However, the out- 
av ratings of all stories contributed by the 
vided group for each of the pictures are pro- 
sult in Table 3 as normative data to be con” 
ann when the N-TAT or a similar kind of 

oF ‘oe is used. Similarly, thematic a 

Table ‘iad of 10 pictures) are Prov! e 


T 
remes, In analyzing the themes, the sec- 
edition of the check list, the derivation 


Pe Table 3 
nage Frequency of Stories of Various Out- 
come Categories for Each of the TAT 


Table 4 


Percentage Frequency of Individuals Who Have a Given 
Number of Stories of Each Outcome Category 
in a Total of Ten Stories Given in 
Response to the Navy TAT 


Outcome rating 


No. of 
stories =2 —1 0) “Fl +2 Reject X ? 
0 74. 26 49 21 92 91 15 47 
1 19 30 31 33 5 5 9 32 
2 6 4 14 17 3) OMIS 
3 t % Spars 1 GQ & 
4 6 7 11 
5 1 5 8 
6 LARS 13 
7 1 12 
8 8 
9 5 
10 3 


of which has been described elsewhere (2), 
was used. Since there are three new pictures 
(Captain’s Mast, Streetcorner Pickup, and 
Seabag) in this series, it was necessary to re- 
vise the check list further and add some new 
themes.” However; the number of changes 
necessary was not significant. Reliability of 
the “Navy” check list was good. Percentage 
agreement between two independent raters 
was calculated according to the following 


formula: 
(No. of agreements between Judge A 
and Judge B) X 2 1 
Total judgments A + Total judg- 
ments B 
for a total of 200 stories 
ae eae Ts 


es well i } 
e) study by different investigators 


Pict i Series (7)- : 
ictures in the Navy 9€ The mott frequent themes for aes pietaz a 
; ` A r cent or more of tae subjects in 
i a eqn ae 100 sailors or in the races ee 
No, ~2 1 o 4i +2 Reject X ? group (for the comparable pictures gaie iste 
2 k li hemes, defining each 
a 49 i 3 The Navy check list of themes, } 
3 1 18 8 = A Ee oe € ad noting the changes, deletions, andiaadi. 
3 | one 1 : a aas tions to the second edition, has been deposited wi 
5 1 42 i 2 26 10 hi American Documentation Institute. Order Docu- 
6 K 5 vi = 2 8 57 3 bed t No 1 from I Auxiliary Publications 
7 9 23 9 4 2 1 35 Je merce Photoduplication Service, Library of Con- 
8 Dek. i! oF 5. 3 Proj rashington 25, D. C, remitting in advance 
9 ai.» 44. TB 1 4 13 Es for microfilm or $2.50 far photoon ice 
ó š hief, Photoduplication Se! vice, 
Leta. 5» 119 2 $i g checks payable to Chi i 


E 
È 
3 


Library of Congress- 
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Death or illness of peer 


Sultan, and Frank Auld, Jr. 


Levels of interpretations It was necessi 
to develop a new scale for levels of ee. 
tion in this study because of the aite d 
in administration from the standard me int 
Stories were designated on an Tight PA 
scale going from complete rejection ding A 
Picture to complete narrative (includi 


m ich 
* This category does not refer to a variable t: } 
carries a similar name in previous i 
3, 4). The latter variable is now called “u 
formal characteristics,” 


31 2.7t 
IB12 cath or illness of central character 25 14.7 
IC6 War 21 29.3 
IB29 Death, illness—unspecified character 18 7 
IB14 Reminiscence, sad 17 6. 
IB7 Guilt 15 
ICS Aggression from—impersonal A 8.0 
IA3 oncern—peer 
B Aspiration” 6 ret 
TAla Death, illness of parent 7 18. 
2 
(10 Minute Break) IB4 Retirement 47 68.0+ 
IB21 Exhaustion 45 14.7} 
IIB3 eminiscence, happy 31 4.0f 
IC7 Escape from perilous environment 13 
IC6 War 10 9.3 
IB19 — Vacillation 13.3 
A IB2 Tranquillity 16.0 
(Father-Son) IAib Succorance from parent 62 74.7t 
TAit isappointment in parent 14 
TAla ressure from parents 6 28.0f 
A IB11 ccupational concern 4 25.3t 
(Captain’s Mast) TAla Pressure from Parent 92 
Ic7 Scape from Perilous environment 35 
B13 tribution 31 
IC4 S8tession toward environment 25 
IB7 Guilt 17 
(Submarine in IC5 A tession from—} 61.3¢ 
Storm) Ico We ™—impersonal z 53t 
TIAIf Contentment at home 26.7 
IB9 Fear 10.7 
6 
(Morning After) IA2h Illicit sex 64 42.74 
1B7 Guilt ae 54.7 
IB8 Drunkenness 17 13.3 
IA2j eath, illness of Partner, female 15 42.7t 
TA2y enereal disease, Partner 14 
TA2e Aggression towa; 


rd partner 17.3 
IB13 Retribution 16.0 


E 
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Table 5—Continued 
Percentage frequency 
= a Theme Navy College 
(Contemplation) IIB3 Reminiscence, happy 27 12.0 
1B28 Homesickness 22 
IB17 Loneliness 11 53 
TA2s Unrequited male partner 10 5 
IB5 Suicide 10 27 
IB3 Curiosity 26.7 
IB1 Aspiration 22.7 
IB4 Behavior disorder 14.7 
IB10 Rumination 12.0 
IIc Favorable environment 5 10.7 
8 IIB2 Tranquillity 10.7 
(Pickup) 1B7 Ordinary activity 34 
IA2pp Decision, female partner 23 
IA2n Competition, partner 21 
IA2q Pursuit, partner 17 
IAla Pressure, parent 15 
IA11 Disappointment in, parent 15 
IC2 Legal restriction 11 
9 IA1b Succorance, parent 10 
(Persuasion) TA2r Seduction 24 10.7} 
IA2c Succorance, partner 22 22.7 
IA2a Pressure, partner 19 50.77 
TA2xx Ulterior motive 14 
TA2f Departure from partner, female 13 16.8 
IB12 Illness or death central character 13 AS 
TA2h Illicit sex, 9 at 
IA2m Competition yh 
10 IB6 Moral struggle x 
(Seabag) TAid Reunion, parent 2 
IIB3 Reminiscence, happy i 
IB1 Aspiration |, 13 
IB7 Ordinary activity ia 
zo TIBS Occupational satisfaction 
nly th —_———_ group are included in this table. 
Ree ee sare RGAE conden 


Cong g: 

g and interpretation of feelings and 

hearg in S the characters). The scale ap- 
Steen ¢ able 7, The percentage agreement 
Or eac wo raters for 200 stories (20 stories 
Pf the v of 10 pictures) was 85. The incidence 

Table „mous levels for each story appears in 


e 

Pres ie s, rom this table and Table 9, which 
ilthoug hematic norms, it can be seen that, 
pa SS wel an of the pictures tend to elicit 
H t or eloped stories, the general level 
na in the responses indicates a goo 
3 volvement on the part of the ma- 
method 


of ot subj 
adm;.. Jects x s 
inistration’ even in this grouP 


Ce 
Perce Ptual distortions. From the number of 
distortions listed in Table 10 it 


erceptual distortions are 


not nearly so frequent among the group of 
sailors as they were among the original stand- 
ardization group 3). The lack of distortions 
is probably due to group administration, be- 
cause the subjects can study the pictures 
more carefully and need not write down their 
first impressions. Also, since a new set of pic- 
tures was drawn Up for this series, it may be 
that these pictures differ in ambiguity from 
the original set. One outstanding difference 
in results between this group and previous 
groups is in the number of rejections. In the 
previous studies such behavior was rare even 

ho were psychiatrically ill 


among subjects W 
(2, 3); in the Navy group, 10 per cent of the 


can be seen that p! 


Leonard D. Eron, Florence Sultan, and Frank Auld, Jr. 


72 89 91 85 89 o5 47 
22 5 


$ Daly, those themes 
$ Themes given here by cod 
269-282), Ti 
» ulterior motive; [B2] i 
pe from perilous environment, efinitions of these the: 
mentation Institute (see footnote 3). 


A2g IA2h IA2k TA2q IA2r IA2u IA2vt 


¢ by any subject are included i; 
e § number have been defined in Table 1 

e themes indicated by ¢ are ori; M 
disease; TA2xx, i 
esca] 


r: ; JAJI 
IA2xxł IA3b IA3c IA3i IA3j 


94 
$ oS a os so aog 
13 30 7 17 15 6 10 


1B34t 
1B9 1B10 IB11 IBI? 1B13 1B14 [B16 IBI7 IB2it 


Theme 5 TIC! 
theme IC2} 1¢3 Icik Ics Ice IC7t Ig IIAld TIA3q IIA2e 11 B3 IIBS IIB Fi 
0 81 94 70 45 57 52 93 51 91 92 40 86 50 9 
1 17 5 28 50 27 
2 2 2 5 


44 8 7 40 13 3 2 
1 5 1 L a5 1 10 
4 1 


in a previo; 


P 17 (4, 
ot article published in this journal (1953, 
original with the N-TAT and thus do no i 
xh: i IB34, grief; IC2, |, 


enere: 
: TA2v, vendey, 
a ar in that list. They are: t; ICh 
appes + aggression toward environments ocu 
ist deposited with the America 


nt 
ast one picture The in- individual administration, With the p ne 
creased rejection Tate is Probab] a func- Method it is difficult to assess the exact ca 
tion of the group administration method. of this large number of rejections. 
t is easier to insure Maximum Cooperation 

Toughout an entire test serj 


Table 7 


Application of the Method 


aH his 
The Practical utility and validity of Be 
type of Psychometric analysis of the N- 


ie jects and Pictures in the Navy Series 

G escription of action Š Level rating 

D Description of feelin; attitudes, icture 
of characters E and/or thoughts no. AIB Te DED re TARN 

E Incomplete narrative—omits either antecedents 1 Ce ritmo 
present action, or conclusion a 2 REE 27 12 32 5 

F 'omplete narrative—includes antecedents, Present 3 1 O 37 16 12 29 3 
action, and conclusion 4 aN 3). “io Want A 

G Incomplete narrative with interpretation of feel. 5 8 15 94 10.907" E poe 
ings, attitudes, and/or thought: 6 1 a) aay 16 EO Y 

H omplete narrative with Interpretation of feelings, Y. 5 ig: 3 5 24 39 6 
attitudes, and/or thoughts 8 1 š 18 26 12 30 5 

W Not really a Story, reflection on life, words, advice, 9 2 325 7 23 31 4 
Temonstrance 10 1 foie gall 18 15 35 8 


eee 
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Table 9 


Percentage Frequency of Individuals Who Have a 
Given Number of Stories of Each Level-of- 
Interpretation Category in a Total of 
Ten Stories Given in Response 
to the Navy TAT 


Level rating 


No. of 
Stories A BC b EB £ G BW 
: 91 s5 60 61 41 28 33 12 82 
2 5 15 16 28 30 26 23 21 9 
A 3 12 9 16 17 2 14 3 
A 1 sug Tea 
5 2 T Wotka 2 
3 1 1 S Tu 
> 4 > 2 8 
8 = ? 
i 3 1 
9 2 1 
10 1 1 


ly demonstrated in a study the results of 
a are fully reported elsewhere (5). A 
2 D arison was made of TAT stories told by 
Subm: ilors before they were sealed up M a 
While thee and the stories told by them later, 
to de ey were still enclosed. It was possible 
in Ache onstrate, on the basis of the protocols, 
for as ways the 22 men who volunteered 
ditet? experiment (“Operation Hideout”) 
and S from the usual run of submariners, 
appen So to enumerate the differences which 
e et patho their fantasy productions after 

ant Xperimental treatment. These changes 1 
asy coincided with differences observed 


ae Table 10 
Tease Frequency of Perceptual Distortions m 
Each of the TAT Pictures in the Navy Senes 
Picture" 
No, 
Distortion Fenna, 

1 

Patient as female 4 

2 Picture within picture 2 

3 Responds to only one character 

4 Self-image t 
5 

Stove or gun cover i 

Serpent i 

Fish % R 

Rabbit i 

Ocomotive—cat face 

6 ragon a 
7 
8 
9 

10 Female seen as mother a 


Gun with arms and legs 


in physical, physiological, and psychomotor 
functions. 


Summary and Conclusions 

A psychometric method of analysis of TAT 
stories derived from protocols obtained in the 
standard manner was extended to a group 
adaptation of the TAT which is used by the 
U. S. Navy. The test records of 100 system- 
atically selected submariners were analyzed 
for emotional tone, outcome, themes, level of 
interpretation, and perceptual distortions. 
The reliability of the scales and check lists 
used was demonstrated to be of sufficiently 
high order to warrant their use with this type 
of administration and this type of subject. 
Both apperceptive and thematic norms are 
provided for the convenience of those using 
this adaptation. This psychometric procedure 
was tried and found to be useful and valid in 
4 research which is reported in a separate 


monograph. 
Received June 16, 1954. 
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The Effects of Sexual Stimulation Under Varying 
Conditions on TAT Sexual Responsiveness 


Paul H. Mussen and Alvin Scodel 
The Ohio State University 


The present study is concerned with the 
effects of sexual stimulation in different situa- 
tional contexts on subsequent TAT sexual re- 
sponsiveness. Our hypothesis states that these 
responses will be more inhibited following sex 
arousal in the presence of a stern father fig- 
ure than following such arousal in the pres- 
ence of a young, permissive individual. 

A procedure almost identical with the one 
described by Clark (1) was used. The sub- 
jects were two groups of male students in an 
introductory Psychology course. Both groups 
took the TAT after having been exposed to 


ies. Subjects were 


told that the Tesearch was related to Sheldon’s 


body-type theories. They 


Using the same instructions 
ing, informal, permissi 
presented the slides to the 
(38 subjects). 


1An extended Teport of this st 


e latter source 
order Document No. 4439 from ADI A: : 
lications Proje 


of Congress, Washington 25, D: Ç 


e 
In both groups, the first examiner left E 
room immediately after the ratings were E 
pleted. At this point, another experime ae 
stepped forward, explained that he eee 
tempting to standardize a test of a hi 
imagination, and then administered aie 
TAT cards from the Murray series (7 E 
12BG, 3BM, 14, 20, 6GF, 6BM, 13MF) 
the group. f 
The Siei and implied sexual content % 
each TAT story was scored according E- 
seven-point scale, ranging from 0 to 6, ity: 
pending on the intensity of sexual eae. 
The subject’s total sexual response score 
the sum of the scores on the eight ea y 
The mean sexual response score of the for 
formal group was 9.55, while the mean nd 
the Formal group was 7.12 (SD’s, 5.18 Er 
4.26, respectively). The difference betw i 
means yielded a ¢ value of 2.13; significa 
between the 2 and 5 per cent levels of CO 
fidence. ally 
Thus, it would seem that arousal of socia FF 
disapproved needs in the presence of an p 
thority figure results in greater inhibition a 
subsequent expression of that need ke 
arousal of the same need in a permiss! 
situation, 
Brief Report 
Received November 11, 1954. 
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The Diagnostic Significance of Usual and Unusual 
TAT Stories 


Jerome S. Miller and Alvin Scodel 
The Ohio State University 


In spi 
i a of numerous efforts, direct and 
not been i to validate the TAT have 
to this diffic pong successful. Contributing 
in activists ty are such factors as variations 
Ployed by ae and scoring procedures em- 
in interpret a of the TAT and differences 
orientation. ion as a function of the clinician’s 
™Mportant and purpose. But, perhaps most 
of the as major problem in validation 
criterion q ies in the elusiveness of adequate 
Cal or th ata, combined with a lack of clini- 
it is es practi agreement as to just what 
espit is to be validated. 
e these obstacles to its demonstrable 


Cceptabili 

for anity, oiher approaches are available 

eliciti mining the TAT’s efficiency for 
or 


example meaningful interpretive data. 
on whi i nstruct validity, or the principles 
can be ch such an instrument is based, often 
bility k to test. Demonstrating the plausi- 
Way whi A nderlying assumptions js another 
inferences also can lend to the credibility of 
indzey from such an instrument. 
*Xplorin y has recently published an article 
(4), Sa thii latter of these two alternatives 
7 mptline mined a number of pertinent as- 
in race the TAT and evaluate 
mace in T light of empirical evidence avail- 
esign e literature. Our present § ud 
od b ed to extend Lindzey’s alternative 
n and a isolating one underlying assump- 
thane pag it within a TAT situation. 
ag stimula c assumption to be tested 
ane SSticall s-bound responses are not 
Li, less S4 significant as responses 
Th 2ey mage by the stimulus material. 
P ated that this assumption—“ 


Ariea S “4 
Nas Dire Story Elements That Appear to 
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[Are] Less Significant than Those That Are 
Not Directly Determined by the Stimulus 
Material . - - »_js consistent with data from 
the investigations of “new look” perceptionists 
(4, PP- 13 f.). 

Stated in another way, the assumption we 
studied refers to the significance of the un- 
usualness of a response, ie., the degree to 
which an idiosyncratic 
production is 
cent study states in the 
«Despite the scarcity of normative 
various clinical 


> content in a TAT record provides a 
diagnosis” (8, 
« „in the inter- 
iven protocol it is felt that 
this study offers further evidence that fantasy 

is important chiefly when it deviates 
from the expected response” (p. 157). 

Rotter states that «Occasionally the sub- 
y which has little or no sig- 
in terms of his basic problems. 
a stimulus which he does not 
tionally, he gives some common 
d on relatively superficial 
experiences with such situations” (9, pp. 83- 
g4). Murray makes 4 somewhat similar point 

emphasizes the jnterpreter’s task of 
« _,, noting everything that is unusual, un- 
common or unique; oF common but unusually 
high or low in intensity OY frequency (5, pp- 
. Or as put by Rapaport et al, “The 


data, 
that 


it is an 
may be measured. The 
the more amenable is 


to diagnostic interpretation” (7, Ps 
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421). In general then, many psychologists in- 
terpret TAT themes on the basis of variation 
from implicit or explicit norms of typical 
themes. 


Method 


Normative data for the TAT have been 
notably lacking. Therefore, there are no avail- 
able standards by which to measure the de- 
gree to which a given response is determined 
by the stimulus material. Moreover, there are 
no empirical norms representing the common 
or usual response elements for each stimulus, 
An exception to this deficiency exists in the 
introductory set of card-by-card norms Te- 
cently published by Eron (1). These norms 
le for emotional tone 


tained three stories given to each of fi 
stimulus cards G, 6BM, 7BM, 12 KAT 


i M, and 1 
Each subject’s successive stories to 2 


Table 1 
Distribution of Sums of Squares of Two Judges 
Ranking Differences for a Five-Point Scale 
(N = 35) 
Frequencies 
Sums of — 
differences n D 
squared Theoretical Observed Theoreti 
0-10 7.87 29.0 sn 
12-16 5.84 2.0 154 
18-22 7.59 4.0 170 
24-28 5.84 0.0 A 
30-40 7.87 0.0 7.8 
=a U 


Note.—x? = 74.67 (df = 4), p <.0001, C = .72. 


who were in Psychotherapy for two or more 
treatment sessions at a mental hygiene clinic: 
At the time of this study all 35 had disco? 
tinued treatment and were “closed” cases. 

These stories were presented to two a 
perienced clinicians who independently ranke 
the stories on a five-point scale, the mo 
unusual story in a protocol being ranked 
and the least unusual (or most usual) story 
“3.” Only the first stories given to eac 
stimulus card were used. The two judges ota 
employed their own private, implicit nor™ 
for this task. 

Reliability of selection was measured H 
using Olds’ form for the distribution of ue 
of squares of rank differences (6). A 2 
Square was computed between this expecte? 
distribution and the distribution of D? Þe 
tween the two judges’ rankings of the stories: 
This yielded a chi square of 74.67 with df = 

and $ < .0001 as shown in Table 1, Wheté 
the two selection judges were not in exac 
agreement at the extremes of the scale, 2 
third experienced judge arbitrated the dis- 


agreements. In this way 35 usual and 35 une 
usual TAT st, 


Procedure, 3 
individual cards without further identifyinS 
data and pri 
judges attempted “blind” 


scripts of the first two psychotherapy sessions 
of each of 


therapy records 


and the two Stories—the usual and the un- 
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u: 


a responding to each of those records. 
with one bar to match each of the stories 
aware dat the records. The judges were un- 
hey oe there were two kinds of stories. 
ale ener eae! that the stories 
Possible os tained originally so that it was 
same Eisen, two different stories from the 
subject Ai us card to have been given by one 

E ay se den number of stories matched with 

Bie on ranged from none to five. 

Be for: length precaution was to equate roughly 
group. Th all stories within any particular 
of APA was done to reduce the possibility 
asa bàsi t productivity or verbality to serve 

or matching. 


Th Results 

_ The 

Mgs 3 peed of correct and incorrect match- 

are sho the usual and unusual TAT stories 
wn in Table 2.1 Chi squares were com- 


| Table 2 


Resul 

t r 

` eo udges in Matching Usual and Unusual 
tories with Psychotherapy Records 


Judge 


eel 


A B GC D EPE 


ate 
a i B 7,89 {faut 


nma 
Number area mM (ee Be 
atch musual 
Ci 
nmat ia g 17 158 u 21 
3 S at 2p iaa Ma 
02 024 000 204 2181024 


P ap ee iS oe 


Ote, 

—Combi 

Duteq ombined x? = 12.46 (df = 12), 2 >40 6). 

` f ' 

“enifcan each judge separately- The over-all 
Nisin of combined results was also com- 

ang | Using the chi-square model of Jones 


isk 
iidee’s si (3) on the assumption 
at ae are treated to te BOTN 
“sult, Ociated with each of the other judges, 


s. Thi ; 
“Ware his combined result provides @ chi 


b Value sp4 which, with df= 12, gives a 
Silay, approximately (‘Table 2)- 
minati Y, chi squares were computed after 
ie Jud hg instances where a judge had cor- 
ects oes E 
f dats pace = and F matched against only 34 sub- 
| Cory became s, individual resumed treatment and his 
’ tag, t ma chan tvailable. The chance probability of 
Judge, ing remained the same, howeveh or 


Table 3 


Results of Judges in Matching Usual and Unusual 
TAT Stories with Psychotherapy Records: 
Paired Matchings Eliminated 


Judge 


Number of usual 


Matched 5 8 ye ait 4 8 
Unmatched 4 #22 #18 16 23 17 

Number of unusual 
Matched eek) 9 (fe liye eA 
Unmatched 21 20 18 20 Alp aks 
x (f= 0.90 0.32 0.00 1.32 348 1.34 
35.63 1.00 26 .06 .26 


P| ie anl eee 

Note-—Combined x* = 14.04 (df = 12), $ >.30 (3). 
oth the usual and unusual 
This was done to determine 
me of the lack of difference 
due to matching mediated 
by extraneous Cues. A usual story, in some 
cases, might have been paired with its cor- 
responding unusual story through similarity 
of language factors in the stories, administra- 
tion techniques, the examiner’s individual 
fashion of recording, etc., thus supervening 
direct matching to a therapy record. However, 
even with these cases deleted, the data fail 
to show 4 marked superiority for the match- 
ing of unusual stories. 

To determine whether the frequency of 
correct matchings was high or low over all, a 
chi square was computed for usual and for 
unusual stories each versus chance expectation 

Table 4)- Chance frequency was 11 for each 


two kinds of stories for each judge. 
oe F) matched unusual 


judges (C; 
Three T ‘ ‘ 05 level and three 


rectly assigned b 
stories (Table 3). 
whether or not so 
might have been 


Table 4 


i { Usual and Unusual TAT Stories: 


Fach Versus Chance 


Judge 


Chi square A pD G: D E F 


Usual sg 9g 53 Ame 849% 0.00 4.86" 


chance 
Unusual vs- agar 13.48" 


chance 0 2.12 4.77% 2.12 


1,2 


igni % level. 
isticalll significant at the 5% levi 
hi statea significant at the 1% level. 
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(C, D, F) matched the usual stories at better 
than the .05 level. With the use of Wilkin- 
son’s table (10) the combined results show 
that both the usual and unusual stories were 
correctly matched more frequently than by 
chance at about the .002 level. Both usual 
and unusual stories then were apparently 
matched with better than chance accuracy, 
with neither type of story showing significant 
superiority. 


Discussion 


Essentially, our interest lay in a demonstra- 
tion of a “back-door” approach to the prob- 
lem of validating the TAT and similar fan- 
tasy-production techniques. Testing an under- 
lying assumption is not, by any means, either 
a crucial test of the TAT’s validity or a de- 
cisive illustration of such an alternative, back- 
door course. The surprising feature of the 
study is the lack of confirmation of an as- 
sumption generally accorded high face validity 

n by clinicians, 


However, the two selection judges showed 
high agreement in their independent rank- 
ings, and we must conclude that there were 
in general, discernible differences between ade 
jacent stories throughout the five ranks—not 
merely between the first and fifth ranks, 


Secondly, no TAT card yields but m 
cliché response. For example, Eron fo 
that stories to Card 1 fitted thematic cate 


gories of “aspiration,” “parental pressure 


and “belongingness” in 46.7, 41.3, and E 
per cent of his cases respectively (1). A ju K 
or clinician might then derive a meaning 
differentiating cue by noting which of w 
stereotyped responses is chosen by the E 
ject. Also, even a hackneyed story can ne 
Suggestive by virtue of the intensity of sr 
fairly common theme. Suppose, for examp E 
that a subject has intense dependency nee! “ht 
Then on Card 6BM, for example, re 
expect that subject to depart only minima a 
if at all, from a theme of dependency so C0 3 
monly given in response to this card. ‘oct 
we might be able to differentiate this subje 
from another on the basis of how intense 
his story reflects his need structure in ra 
particular area. Thus, the cliché is also a 
acteristic of a subject and may be revealln 
of him in a broad context. The presence ay 
Tepeated stereotyped stories in a protocol nine 
be indicative of a subject’s method of handli 
his problem areas.2 2 a 
In closing this explorative discussion» 
final question is raised which concerns 2 the 
ference between the task imposed upon E 
judges of this study and the procedure 8° 
erally followed in a clinical interpretation. F 
the latter situation there is some pressu" 
upon the worker to identify the cues and ~ 
integrate and verbalize hypotheses and diag 
nostic descriptions. None of these require” 
ments existed for the blind matching P!® 
cedure. It is conceivable that judges mê 
have derived unverbalizable or sublimin@ 
cues from a story and matched them Wi" 
similar unverbalizable or subliminal cues m 
ferred from the psychotherapy typescripts: 
Tt is not known what effect this freedom from 
explicitness has upon the data. It is possib 2 
In a clinical Setting, however, that the notio” 
* Holt remarks on this interpretative value o 
in his statement that “It may be sa 
frequently a great deal more can 3 
cliché stories,’ than is ye 
e difficult; it requires at 
Which a pee aye senaiyity to. subtle vA aa 
Yped story differs from dead aver ” 


but it is alwa; i SS 
rahe YS possible tı e progre: 
(2, pp. 201-202) Possible to make some pi 
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o s : 2 P 
4 unusual stories having diagnostic advan- 
ge stems more from ease of interpretation 


oa from demonstrably superior predictive- 
S. 


Summary 


pen ee study we attempted to test an as- 
tn re generally held to have significance 
lar fa ap area of TAT stories and simi- 
was os asy productions. The hypothesis tested 
nique i judges using a blind matching tech- 
storie will more often ascribe unusual TAT 
of ah corresponding psychotherapy records 
ù jects than they will correctly ascribe 

Sual stories. 
ge story and an unusual story were 
era A obtained from each of 35 psycho- 
matchin clients, The results of the judges 
e a attempts, however, did not confirm 
evel a othesis at a statistically significant 
iie though each type of story was matched 

cantly better than chance. 

evaluate results were briefly discussed and 
at -i and it was tentatively concluded 
fot qa es cliché, TAT story is 
oe meaning characteristic of its 
er and should not be overlooked as 4 


teso 7 
ac ce for the clinician’s understanding of 
Subject, 


Roca 
“ceived July 21, 1954. 
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The Diagnostic Discrimination of the 
“Basic Rorschach Score” 


Ben C. Finney 
VA Hospital, Palo Alto 1 


The diagnostic adequacy of the Basic Ror- 
schach Score ( 1) was tested b 
the mean scores of groups with d 


noses which were collected and scored by Mc- 
Reynolds (2, 3 
according to th 
p. 80). In ordei 
those reported 


Ported in Table 1. 


In McReynolds? samples 
nificant diff 


; tween the 
Neurotic and the ombined Schizophrenic 
groups was significant at the .05 level. 


When McReynolds’ and Buhler’. 


1An extended Teport of this stu, 
tained without charge from Be 
Hospital, Palo Alto, California 
the American Documentation Insti 


VA 


film or $1.25 for Photocopies. Make check. 
to Chief, Photoduplication Service, 
gress. 


S payable 
Library of Con- 
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hl- 
higher than McReynolds’ Normals and Brai 
er’s Neurotics were significantly highe a 
either McReynolds’ Normals or Neuroti 


Table 1 
Basic Rorschach Scores 
SD 
Diagnostic group N Mean 74 
12. 
Normals (McR) m = 7.12 © Ga 
Neurotics, Mixed (McR) 22 — 10.00 44.13 
Schiz, Par. (McR) 31 15.00 ig 
Schiz. Mixed (McR) 33 18.76. antag 
Schiz. Combined (McR) 64 16.98 E 
Paretics (McR) 24 — 26.42 3 
6.0: 
Normal (Buh) 89 18.90 a 
Neurotics, Comb. (Buh) 176 8.90 13.07 
Schiz. Par. (Buh) 2 See Fe 
Schiz. Mixed (Buh) 63) wda nee 
Schiz. Comb, (Buh) 92 — 16.89 


These results 


, imila" 
suggest that despite sim! 
diagnoses, 


McReynolds’ and Buhler’s a 
ples were not from a similar population 4 
that within McReynolds’ population, for 
Basic Rorschach Score was not adequate 
use in diagnosing individual patients. 

Brief Report 
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P ; A 
sychotherapeutic Technique, Professional Affiliation, 
and Experience Level’ 


Hans H. Strupp * 
Washington, D. G: 


To 
to a n that psychotherapy aspires 
tational en status, it must be based upon 
cise eo that are capable of pre- 
aty of this ion and communication. A corol- 
Peutic öper ‘saga is that psychothera- 
e anirem ions are not teachable unless 
© this E of communicability is met. 
aE its ara psychotherapy must strive to 
working assumptions, hypotheses, 


and 
. Operati f 5 
lective, ations increasingly explicit and ob- 


Preyi 
Primarily. research in this field has dealt 
Sult of fear changes in the client as a Te 
prg, ekin P diagnostic studies of the Per” 
o Cess wd elp, and the development of 
Pncerned naa? Few investigations have 
Retapist themselves with the person of the 
in 0 i the character of his contribu- 
awn as e dyadic interpersonal situation 
an a Psychotherapy” Yet it is almost 
analytic and has been recognized in PSY" 

that ‘the writings since the time of Freud 
bli i ae pal personality, attitudes, 
z rsonal experiences, and emotional 


Spot, 
S . . 
l are among the prime determiners 


Bati his arti 
19 Tticle į r : 
nis is the second in a series of investi- 


Chops © 

t] ‘Once 4 

bhas TaDista ver with the objective study of PSY- 
to the s the Se ieee operations, and represents one 
te uthor’s doctoral dissertation submitte 


Graq: 
7 U; n 
sity ee el of the George Washington 
Li urti rateful acknowledgment is made to 
an REE T E Lakin Phillips 
D ; a s man, M.D, for valuable suggestions 
siti, le. Cartos 
a on tying out this work, the author ©. 
Ci 
iator a h t of the 
n 
OWrey? 
e re 
of, Fiedter (3) recent compendium only On 
4 $) specifically addresses 
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of his therapeutic operations. It is believed 
that a program of research focusing on the 
therapist’s contribution to the treatment situa- 
tion is potentially productive for advancing 
our knowledge of psychotherapy. 

As a first step, it is proposed to conduct a 
series of exploratory studies directed at the 
therapist’s verbal techniques. This research 
attempts to answer the questions: (a) What 
used by psychotherapists of 
(Rogerian and 


b) Are there systematic 


differences 
fessional a 


(c) Are there 
to the therapeutic problem to which the thera- 


ist is addressing himself at the moment? 
i effect of the therapist’s per- 


Method 


It was considered advisable to avoid the 
of the actual therapeutic situa- 
tudy therapists’ verbal behavior 
e use of a preselected sample of 
atient communications. Thus, a series of 27 
hs of patient statements was 
plished therapeutic interviews, 
A bare mini- 


d information preceded 


backgroun 
which 


juded in the series, 


was considered & e : 
palizations heard from neurotic patients 1n 


early interviews; were a variety of complaints, 
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Table 1 


Scoring Categories and Response Frequencies 
ial 
Psychia- Psy cholo- ae. 
Cate trists gists = 
ey Interaction process “Psychotherapeutic” ” % n oa 
no. analysis definition definition n % 35 o 
1 Shows solidarity, Gives reassurance, encourage- 41 4.0 13 5.3 
raises other’s status, ment, shows compassion, tender- 
gives help, reward. ness. , , 
2 Shows tension release, Not applicable.t 
jokes, laughs, shows 3 
satisfaction. on 70 20. 
3 Agrees, shows passive Shows passive acceptance, under- 184 18.1 39 IS 
acceptance, understands, standing, is permissive (includes i 
concurs, complies. silences), 7 16 4A 
4 Gives Suggestion, Proposes course of action, defines 65 6.4 15 6.1 
direction, implying (“structures”) the therapeutic 1 
autonomy for other. situation. 23 6 
5 Gives opinion, Interprets, analyzes behavior 164 16.1 25 10.0 
evaluation, analysis, patterns; thought in process, 
expresses feeling, wish. inferential reasoning. 59 17.1 
6 Gives orientation, Restates, clarifies, “reflects” 108 10.6 35 14.2 
information, repeats, (Rogerian response). 
clarifies, confirms, 18 5.2 
7 Asks for orientation, Asks factual questions, expresses 31 30 17 69 
information, repetition, lack of knowledge, uncertainty. 
confirmation. 118 34.3 
8 Asks for opinion, Explores, asks for elaboration or 367 36.2 88 35.6 
evaluation, analysis, expression of feeling (includes 
expression of feeling. open-ended questions, “nondi- 
rective leads”), 
9 Asks for Suggestion, Not applicable.+ 
direction, Possible 
Ways of action. 5 14 
10 Disagrees, shows Passive Shows Passive rejection, disbe- 44 43 13 53 
rejection, formality, lief; ignores requests or com- 
withholds help. plaints; thwarts, frustrates. 
11 hows tension, asks Not applicable.t 
for help, withdraws 
out of field, a 
12 Shows antagonism, Shows antagonism, aggression, 13 1.3 2 8 1 
deflates other’s status, sarcasm, irony, cynicism. 
defends or asserts self, 
Total 1,017 247 345 
* This column gives 


t The ab: 


statements by a seri 
psychotic patient, sui 


hostility. 


Procedure and Subjects 
Therapists who had agreed 
were visited and interviewed 
Each interview lasted about o; 


half to two hours. 


examples of the kinds of re Sain 
The absence of responses in these cat esponses by therapists include 
were elicited. 


ously disturbed near- 


cide threats, and other 
transference reactions, such as þ 


tivism, requests for direct ady 


d: 

A defines 

Tesp d in the categories, which were in no ney Mesponse 
*sories is probably a function of the experimental conditions under whic 


locking, nega- 
ice, and open. 


to Participate 
individually, 


me and one- Agnew (4) which 


choice answer form. 


5 e 
The respondent was presented with a 
experimental series of patient statements 
Tequested to state what response, if any, 
would make to the hypothetical patient. z 
therapist was permitted to give as many 0 sea 
few responses as he chose; “silent” respon s 
were also considered acceptable.* Therap! 


*In contrast to the relai 


The 


sipand 
ted study by Phillips @ 


iple- 
restricted responses by a multiP 


Psychotherapeutic Technique, Profession, and Experience 99 


were ask 
na ured cay that the patient state- 
problem came me in treatment, that the 
None of the up for the first time, and that 
responses sa pee were hospitalized. All 
investigator. omments were recorded by the 
In ; 
ing, ies concerning the therapist’s train- 
was erilesied ai theoretical orientation, etc. 
The en, the end of the interview. 
chologists J 2 were 25 psychiatrists, 7 psy- 
litera 3 i 9 psychiatric social workers. 
neo-Frey ie egiance to psychoanalytic or 
ad received principles, and most of them 
ad been j training from, or reported they 
School of P influenced by, the Washington 
ing the « Shen ee powerful agent mold- 
Meton erapeutic climate” in the Wash- 
Fifteen = a 
id 4 ee ea 3 psychologists, and 
“perience j ers had five or more years of 
teated a in psychotherapy and will be 
Sequent - experienced therapists” in sub- 
implies qnalyses- While such 2 dichotomy 
a quite oe arbitrariness, the distinction 
e experien, cut in the case of psychiatrists: 
gat ully need therapists were for the most 
he Stone ate analysts engaged in pri- 
la ectience 4 psychoanalysis, whereas the 
tea” Y of ps hes (N = 10) was made up 
th e experien. hiatric residents with relatively 
to includes ¢ in therapy. The former group 
passional ex the greatest concentration of 
Call V tliologiste and on A 
and ; laed wor social workers were typr 
dias © additi y local mental hygiene clinics, 
8Nostic ion to psychotherapy performed 
and related functions.° 


Result: 
Manes ults 
eon ication . 
li of therapists’ responses was 


te i 

m pe sue 

kno Dte by means of Bales’ (1) SYS 

Scrip ier process analysis, 4 well- 

Tenge’ Social | purpose framework for de- 
interactions. The system com- 


(a) ed its 
e. 
evel 3 pains Or present purposes because o 
‘ aking labor that went into its 
> and (b) its theoretical reu- 


A 
Fy S 
the, Ystem, ; 
si ati . 
Atom ¥choana abon between the techniques 
Vioyg ole aida oriented psychologists 20 
y (6). “P of Rogerians has been presente 


45 

40 — PSYCHIATRISTS 
__-. PSYCHOLOGISTS 

35 —— SOCIAL WORKERS 


PERCENT 


CATEGORIES 


Fig. 1. Response distributions of psychotherapists by 
professional affiliation. 


trality with respect to the teachings of con- 
flicting “schools” of psychotherapy. 

Table 1 presents Bales’ 12 categories, to- 
gether with the response frequencies of psy- 


chiatrists, psychologists, and social workers. 
The reliability of the writer’s categoriza- 
atified random 


tions was tested upon a str: 
sample of 10 cases comprising 4 total of 370 
score units. Two judges who had been trained 
in the Bales method independently scored 
the ten test” cases. Average rater agreement 
was 78 per cent. 7 
Figure 1 presents the frequencies shown in 


Table 1 in profile form. Table 2 attempts 4 
the profes- 


in any one res 
the formula for uncorrelated 


Table 2 
Comparisons (t V: glues) Between Professional Groups! 
Psychiatrists Psychiatrists Psychologists 
Response VS: psychol- vs. social _ yS social 
category ogists workers * workers 
1 .93 4.36** 2.09* 
3 95. P 92 1.41 
4 He L .20 83 Ps 
5 2.40* P 4.48** P 1.48 Ps 
6 1.64 305" 97 
7 2.79" 1.83 85 Ps 
8 45 P 6 PF 45: Ps 
10 67 2.42* P 2.79** Ps 
12 63 P 1.50 P g Bs 


quency of psychiatrists exceeds that of 


p—The response fret 
the other response frequency of psychologists exceeds that of 
ing a two-tailed test. 


e .05 level ust il 
* Signifa at the .01 Jevel using & two-tailed test. 
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PSYCHIATRISTS 


2 
z 
r 
o 
œŒ 
w 
a 
CATEGORIES 
50 
PSYCHOLOGISTS 
45 
40 
35 — EXPERIENCED A 
~--- INEXPERIENCED ' 
E fa) 
= 
uJ 
o 
roo 
w 
a 


CATEGORIES 


. Fig. 2. Response distributions of experienced and 
Inexperienced Psychotherapists. (Experienced psy- 
chiatrists N=15, n= 595; inexperienced Psychia- 
nee N ee n= 422; experienced Psychologists 
=3, 2=117- inexperienced hologi = 
wait 5 Psychologists N 4, 


percentages) disclose the following statistically 
significant differences: 


workers make greater 
use of reassurance (Category 1) than either 


psychiatrists or psychologists, 

Inconsistent differences in Cate; 
7, while possibly quite real, ha 
regarded for the present. 

The next analysis addresses itself to the 
question: Are there significant differences þe- 
tween the response distributions of experienced 
and inexperienced therapists within a pro- 


gories 6 and 
ve been dis- 
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fessional group? In other words: What is E j 
effect of length of professional experien 
upon technique? 

Figure 2 shows the results in profile ig 
significant differences being indicated 4 al 
graph by the appropriate significance an 
Social workers, while showing a ree 
pattern similar to psychologists, have a 
omitted because of the very small WV for | 
experienced practitioners. milar; 

The distributions are again rather sim 
however: T 

1. Experienced psychiatrists use moraa 
terpretations and a larger number of pas 
rejections. 2 

2. Inexperienced psychiatrists reveal a ra 
dilection for exploratory responses (Categ 
a) f the 

With respect to psychologists, none 0 but 
differences are Statistically significant, aie 
the aforementioned shift in Category 8 se 
to be in the same direction, 


Discussion 


P m 

The most striking finding emerging be ; 
the comparison between psychotherapis sae 
different professional affiliations but saree 
parable theoretical orientation is the files: 
degree of similarity of their response Praen 

Of the three statistically significant di one 
ences between professional groups, oniy to 
(reassurance) appears to be attributable 
professional affiliation. The second (intetP on 
tation) is more adequately accounted a p 
the basis of experience level, and the t 
(passive rejection) is somewhat in doubt. a 

One may regard the preponderant 

reassuring responses by social workers 2 n 
move away from insight-producing “uncov 5 
ing” therapy in that this technique able 
but actually changes little. This is not to pt 
that a certain amount of reassurance may ily 
be desirable, beneficial, or useful in the ea oie 
Stages of therapy, particularly with a se 
ously disturbed or very anxious patient. A 

2. The finding that psychiatrists aE 
Psychologists and social workers in the nu es 
ber of passive rejection responses is a provoci 
tive one; but because of the relatively A 
frequencies it js merely reported as suggest! ‘ 
of a possibly important difference (see below 


Psychotherapeutic Technique, 


Wi 
en to experience level, it is in- 
Mat great ee that psychiatrists show some- 
E on = ivergence than psychologists. 
ential RA ae function of the greater differ- 
lysts and xperience between experienced ana- 
ae residents than between 
sional sae of varying degrees of profes- 
chologist«. rience. While the sample of psy- 
fairly. he was small, the group appears to be 
kgs anti as long as we disregard 
erapists whose techniques, as we 


Nave sh 
wA own elsewhere (6), are radically dif- 


The princi 
aa Prcipal technique differences between 
concern ( and inexperienced psychiatrists 
and (c) a) interpretations, (b) explorations, 
passive rejections. 
a, A 
appears A Sema becomes more experienced, he 
rane It Aa ace greater emphasis upon interpreta- 
teristic ee also demonstrated (5) that this char- 
Psychiatrist, t only differentiates reliably experienced 
SYchologist, from inexperienced ones but also from 
attesi signif and social workers. 
ees paces pt hla jewel is twofold: (i) it 
crienced emphasis given to interpretations by 
Dayar iae gelne ego in that this professional 
i hoanalytic re more closely than any other, 
cont € hallmark octrine, which extols interpretation 
such Venes to of intensive psychotherapy; (i) it 
catty authorities as extent the recommendations of 
fo again. ae as Fromm-Reichmann (2) who 
"matig st interpretations before sufficient in- 
tho, cen i tic maneuver 
horo oe Thus, psychiatrists, 25 the most 
Sy © be en group of therapists, might be ex- 
ore wary of interpretations, but if 
evealed by 


significant 
inexperience 
observa- 
nd therapists 
ency to ask more exploratory ques- 
e expense 
KATARE Tt appears 
ed ș,  easonable for a therapist when con- 
knows little 
re we ha 
sychiatrists 


or 

a Pronounced tendency tO develop 2 
Dr aa along exploratory lines whereas 
actatio Ychiatrists proceed more readily tO 


While we cannot answer the ques- 
apeuticallys 
t 


Asp) 
tion, > è te 


Whi s 

EENEN more effective ther 

ten, ration, e suggestion that to 
ce S are a sign of inex 

erapists with medical twain 


: If in doubt, ask 
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This result gains further meaning i i 
the comparison between OT eae t o 
enced Rogerian therapists presented in the first dy 
of this series (6). It was shown there that fee 
perienced Rogerians give a significantly larger num- 
ber of reflective responses than their more experi- 
enced colleagues, the reflective response perme the 
most favored variety. In the present study, Category 
8, the preferred response of psychiatrists, eavenisitht 
same relationship. The implication is clear: Regard- 
less of whether we deal with the Rogerian or the 
psychoanalytic frame of reference, the most popular 
(stereotyped ?) technique derives a good deal of its 
popularity from inexperienced therapists, and under- 
ced decline as the therapist becomes 
more experienced. It is true that this trend is more 
pronounced for Rogerian psychologists than for 
analytically oriented psychiatrists, but the same con- 
clusion seems justified: An increase in experience 
leads to 2 diversification of therapeutic technique, 
and, conversely, reliance on one specific technique is 
a characteristic of inexperience. 
c. Because of the small frequencies, it is difficult 
to say whether passive rejection is a technique pre- 
ferred by experienced psychiatrists or by psychiatrists 
in general, although we are inclined to accept tenta- 
tively the former interpretation. 
Summary and Conclusions 
n a series of investiga- 


tions to elucidate the psychotherapist’s con- 
tribution to the treatment situation. It at- 
tempts a systematic comparison between the 
techniques used in early interviews by PSY- 


chiatrists, psychologists, and psychiatric social 
psychoanalytic prin- 


goes a pronoun 


This is the second i 


workers subscribing to 
ciples Therapeutic responses were secur 
ists, 7 psychologists, and 


from 25 psychiatr t 
9 psychiatric social workers of varying de- 

i jence by presenting 
ments extracted 
iews. A total of 


categorized by 


se units were 
f interaction process analysis. 
er cent. 


t was 78 pi 


ater agreemen 
marized as follows: 


Average ° mee 
zont results may PC S 
Sine e profiles of the three pro- 

groups manifest @ considerable de- 

gree of similarity. Of the statistically signifi- 
only one appears to be a 

function of p ional affiliation, namely the 
i jal workers’ predilection for re- 


sons between experienced and 
e ractitioners among psychia- 
ychologists (social workers were 
small N for inexperi- 
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enced workers) disclose the following reliable 
differences: (a) experienced psychiatrists give 
a larger number of interpretive responses; 
(b) inexperienced psychiatrists show a prefer- 
ence for exploratory Tesponses; (c) experi- 
enced psychiatrists use more Passive rejec- 
tions. 

It is concluded that professional affiliation 
exerts a relatively minor influence upon the 
kinds of techniques used by psychiatrists, 
psychologists, and psychiatric social workers. 
As long as the variable of theoretical orienta- 
tion is held constant, all therapists adhering 
to psychoanalytic principles employ very 
similar techniques. When experience level js 
taken into account, psychologists emerge as 
a somewhat more homogeneous group in 
contradistinction to Psychiatrists for whom 
more conspicuous differences between ex- 
perienced and inexperienced therapists are in 
evidence. Intensive training in psychotherapy 
seems to stress interpretations at the expense 
of exploratory (probing) responses and leads 


| 
Hans H. Strupp | 


| 
ique. | 
to a general diversification of te 
Previous evidence from Rogerian es. an 
Provides added support for this lat 
clusion. 
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Adj i 
justment Changes in the Absence of Psychotherapy’ 


Rosalind F. Dymond 


Counseling Center, University of Chicago 


It ha 
evidence z ften been argued that there is no 
Slons of ia from the feelings and impres- 
chotherapy chotherapists themselves that psy- 
greater” Ree changes that are any 
Would hay different” from those which 
Portion nh resulted in about the same Pro- 
a psy liotkes if they had not been seen by 
tat many apist. It is common knowledge 
ress “pull people in severe psychological dis- 
Mit” with out of it” or “spontaneously Te 
out having been so treated. 


Procedure 


In the 
watered pe program evaluating client- 
a made a chotherapy (6) some attempt 
a of the ee? this phenomenon. Nine- 
erapy at t he ients who applied for psycho- 
iced of Gi Counseling Center of the Uni- 
je Ore Bene ch were required to wait 
com were pea their interviews. These sub- 
a When oa a battery of psychological 
ieee with i first applied and were re- 
is nth waitin e same battery after a two- 
ne uch too g period. Admittedly two months 
sibility os a time to really test the 
‘ee Bigs ripen’ remission. It was 
the ig ne this was the average period 
to Dist. It esearch cases had to wait for a 
was felt that it would be unfair 


lone cole i 
a in trouble to put off their therapy 


thee thi : 

hey felt Pes for research purposes W en 

of wet me Laas for immediate help. 
hese Dè ing for the two-month period, 11 
Were o T went on to complete their 
the tested x (six or more interviews); 3” 
ird e with the same battery or 
a e. The remainder of the group» 


Thi 
tesen tS investi 
stitun eh oe Ration was supported 
of tye Ë nt (PHS M903) from the 
alth, p al Health, of the Nation: 
ublic Health Service. 


(in part) by a 
National In- 
al Institutes 


ec people, came a time or two and then 
a 
f i These we came to call the 
Grummon (5) has reported that there are 
some very interesting differences between the 
tests done before and after the waiting period 
for these two groups. He found that those i 
who waited and then completed therapy 
showed no improvement over the waiting pe- 
riod on & variety of tests, but those who 
waited and then failed to get started in 
breaking off showed that sig- 
nt had taken place dur- 


per of questions: 
1, In what respects did the attrition group 
change and the therapy grouP fail to change? 
2. Were the two groups drawn from the 
same population or were they differentiable to 
start with? 
3, Were the changes in 
of the same kind as those W 


teristic of successful psychotherap 


the attrition grouP 
hich are charac- 
y subjects? 


Results 


Questions 1 and 2 will be taken up first, 
and the remainder of this pape" will be con- 


ith question 3. 
shows that in terms of formal char- 


ics the attriters do not appear to be 
different from the therapy subjects 
age, SeX, and occupation (student 


or nonstudent)- 

on which the attrition group 
improvement were 
h involved self-description. The 
f these was the Q-adjustment 
j- This Was the scoring for adjust- 
h subject’s sorting of 100 self- 
referent ite g a continuum of “this 

is very like me” to “this statement 


most dramatic 0 


104 


Table 1 
Wait Group Subjects 


Occu- 
Sex pation* 


Number of 


Age interviews 


Rosalind F. Dymond 


Group Mean Range M F S NS Mean Range 
Therapy 


(V=11) 274 22-36 74 8 3 36.6 6-108 
Attrition N 
(N=8) 246 20-29 3 5 3 5 24 15 


*S = student; NS = nonstudent. 


is very unlike me,” The basic instrument was 
developed by Butler and Haigh (1). Table 2 
gives the prewait and Pretherapy scores of 
the two groups. 


The difference between the mean scores of 


the 


Same statistic. The 
means of the two 
was not significant, 
Port the conclusion 
, although the groups were about 
maladjusted initially as self- 
of them managed to j 


-description, did go on to 
c However, all these conclu- 
Sions are based on what the i 


ar ndividual is able 
or willing to say about himself, : 


two-month wait 


Thematic Apperception T pa 


est (TAT). The 


Table 2 
Q-Adjustment Score of Therapy and Attrition Groups 
Prewait Pretherapy 
Se 
Group Mean Range Mean Range 
‘Therapy 28.6 16-38 30.2 15-41 
Attrition 32.0 22-46 42.9 25-55 


-e 


19 | 
prewait and pretherapy records of the 


Í 
subjects were mixed in with the reco 
all the other subjects in this epei ai 
program (6). They were coded and a 1 
fying material was removed. A menta Pye: 
rating was then made for each recor 1 {0 
whole (4). Each record was rated from 


E “bor- 
7 with a rating of 1 being equivalent to | 


A be- 
dering on psychotic or psychotic,’ and ly 
ing a “well-integrated, happy person, 5 anid 
effective.” Table 3 compares the two 
groups in terms of their TAT ne P 

Here, none of the #’s reached signi malad- 
showing that the groups were eqil neithe! 
justed at the initial testing point mee pe 
improved significantly over the wal k with 
riod. This result is sharply at varianc asure: 
the results of the Q-adjustment Pa 
What is the relation of these two ge 
Scores? Rho correlations were run be' 


Table 3 


and 
TAT Mental Health Ratings of Therapy # 
Attrition Groups 


Prewait PretherapY 
— Rang? 
Group Mean Range Mean ae 
Therapy 30 a of 35 
Attrition 36 3-5 3. 


F cores 
the TAT ratings and the Q-adjustment F The 
for both groups at the two testing times- 


t 
47 a 
rho’s for the therapy group were + - 


the 
Prewait and + .30 at pretherapy. For 39 
attrition group, 


the rho at prewait was sul 
but at pretherapy it was — .20! These Aa 
and those of a previous study (3) woul ily 4 
to show that although there is ordin s 
fair relationship between these two mea d 


À hol 
of adjustment, this relationship does not 


time 
for the attrition group at pretherapy © 


is seems to cast some doubt on the aPP 
ent improvement in the waiting perio 
these people 

The lack 
sis for the p 


1y- 
of support from the TAT 8 i 
ositive adjustment change in self- 
description raises the question: Are the pet- 
descriptive changes defensive in ee 
haps in response to the threat of ar? of 
e question brings us to question ce 0 
what does the improvement in the absen 
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Table 4 
Comparison of Attrition and Success Groups on Q Adjustment and TAT Ratings 
Q adjustment TAT rating 
Group First Second = First Second 
score st e a 
Raa. = cori ange score score Change 
Mea 
as 33.0 47.3 +14.37** 3.5 3.5 0 
22-46 40-55 34 3-5 
Success (N = 6) 
Me 
icine 34.83 48.33 +13.50** 3.8 5.0 +1.2* 
23-42 35-54 3-5 46 


was change from prewait to pre- 


their score at prewait and improvement 
hange from pretherapy to post- 


Note.— 
nd improvement was € 


ĉi Fo: iti 
thetapy, while pene attrition group the first score was 
‘apy, he success cases’ first score was 


established at pretherapy 3! 


* Sioni 
significant at $% level. 
icant at better than 1% level. 


ther 
atttitien consist? Is the improvement in the scribe yourself as you see yourself today, 
ae group during the no-therapy period putting the card that is least like you at the 
period me kind as that which results from ‘zero’ end and the one that is most like you 
Pattern of successful psychotherapy? The at the ‘eight’ end, then the four cards, that 
ak TA large Q-adjustment-score increase are next most and least like you at ‘one and 
AT a by commensurate change in the ‘seven’ and so on.” The required distribution 

attrita nS did not hold for all eight of the is shown in Table 5. 
Each item was given 


er: i ; 
of S to an equal extent. However, for six e the weight of the pile 
number into which it 


fell in the particular 


em 

Matched pattern was clear. These six were i a 
€s in with a group of successful therapy sorting. The average sorting that the six 
terms of their initial status and de- attrition subjects made at the pretherapy 


ted and compared to 


point was then compu 1 
rting made by the six matched 


t their posttherapy point. The 
een the two groups in the 


Bree 

of j 

Score, eq Provement on the Q-adjustment 
a was established by 4 three- the average 50 

Crea, rion: (a) Q-adjustment-score in- success cases a 


TA se from preth b : betw 
-rating į erapy to posttherapy ) differences betw y 
therapy ne increase from pretherapy to post- mean weighting of each item were tested for 
ase on er (c) the therapist’s rating of the significance using ¢. Table 6 lists the items 
Six op a nine-point scale of improvement at ficantly different with respect 
Shown ese (7). The matching data are to their average weighting. 
able 4 
ial, ; 
ake a start on the problem as stated 


n 
~ Questi 
t Sti à 
ki E r as mee ee ae he attrition group that emerges 
i the attritio 
is so clear that it 


j S 
Jeety orts were examined. Each of the sub- the pictur t 
o of the items 1S 
g like it would 


z th mice the 100 self-referent itemS from a reading i 
nder the sont testing points into nine piles seems probable that somethin 
instructions, “Sort the cards to de- pe found in a study with more adequate sam- 
ples. The attriters appear to be a group of 
Table 5 “rugged individualists” who are hanging on 
F i “J am someone, I am su- 


f the V’s on which 


ere based puts some stricture 
they warrant, 


Q-Sort Distribution É 
erior, 1 do want to cope and will do it my- 

X pet Most self” "They seem to have difficulty accepting 
y Run, ike me like me the idea of help from others (I am an aloof, 
Rets oa 2 3 s 6 7 8 reserved person; I make strong demands on 
ts petitive; I have 


4 11 a1 26 2 myself; Jam self-reliant, com 
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Table 6 


Q Items Which Differentiate Attrition and 
Success Groups 


Mean weighting 
ee ee 


Item Success Attrition p 


Weighted more characteristic by attrition group 


I am an aloof, reserved 


person. 2.3 4.3 01 
Iam ambitious. 4.3 6.0 .02 
I feel superior. 3.5 4.6 .02 
I am self-reliant. 4.3 5.5 05 
I am afraid of sex, 2.0 3.5 -05 
I just don’t respect myself. 2.1 3.1 -05 
Iama competitive person. 3.6 4.8 -10 
I make strong demands on 

myself. 3.6 5.0 10 
I don’t trust my emotions, 3.0 4.5 -10 
I have to protect myself 

with excuses, with ra- 

tionalizing. 3.1 4.3 -10 


Weighted less characteristic by attrition group 


I want to give up trying to 
Cope with the world, 3.5 


ii .01 
am no one. Nothing 
really seems to be me, 3.8 1.6 02 
Iam liked by most people 
who know me. 8 5.6 05 
T understand myself, 6.0 43 05 


express my emotions 
reely, 


who know me, I trust my emotions, IĮ respect 
myself, I understand myself. All of these were 
more characteristic of the s 


elf-description of 
the successes than of the attriters, 


Summary 


This study has been a bare 


beginning ona 
question which has been an o 


pen one far too 


Rosalind F. Dymond 


long. Although there are many ore aa 
in the study presented here, some me rify 
can be drawn. A summary may help to cla 
the points to be made. : 

1. There was a small group of six ab 
who appeared to have “spontaneously "hea 
ered,” that is, decided after waiting P all, 
apy that they did not want therapy 4 djust- 
and appeared to have improved in pan 
ment, as measured from their self- Pen 
tion, about as much as those who was 
through therapy successfully. This onb 
not initially differentiable in terms of did not 
ment status from the subjects who . who 
improve in adjustment while waiting an 
did go into therapy. , 

2. The attriters’ increase in adjustme 
measured from the self-descriptive p 
Was not confirmed by a commensura ‘a 
crease in mental health as rated blindy rat- 
their TAT’s. On the basis of the TA E 
ings, “the spontaneous remission” group 
peared to be as poorly adjusted at the € they 
the waiting period as they were = dif- 
first applied for therapy, not significant 7 hen 
ferent in adjustment from those who antly 
continued with therapy, and signifi te 
Poorer in adjustment than those gue 
pleted therapy. In other words, in ter ow 
the adjustment scoring of the subject nav ; 
self-description the attriters had impr pro” 
whereas in terms of the scoring of em not: 
jective tests by a diagnostician they ha wed 

3. To discover whether the “impr fet 
self-description of the attriters was + tio? 
entiable from the improved self-descrP < 
of a group which had completed therapy i, a 
cessfully, the attriters were matched w itial 
Successful therapy group in terms of i 
status and degree of improvement on ; T 
adjustment measure. From a compariso. 0 
the average “improved” self-description cp 
these two groups, 15 items were found Ten 
were weighted in terms of “like me” re o 
like me” significantly differently. A stu Sie 
these crucial items appeared to show that". 
“improved” self-description of those who snl 
not go into therapy had strong defensive E 
compulsive elements which were a jp 
significantly less characteristic of the 5€ 
Successful cases as described by them. 


nt as 
sorts 
in- 


Adjustment Changes in the Absence of Psychotherapy 


Te a limited as it is by the small 
covered T cases and short period of time 
Mm as shown that although positive 
Aee changes appear to take place in 
chotheray ed persons in the absence of psy- 
tiange okt these are not identical to the 
Persons He occur in equally maladjusted 
organizati o complete therapy. No “deep” re- 
na appears to take place. The “im- 
a Al appears to be characterized by 
denial e ae of neurotic defenses and a 
In a the need for help. 
Pios studies on this subject, not only 
of no i sample be enlarged and the period 
should rein be extended, but more data 
data to di gathered: additional diagnostic 
Structure E the nature of the defense 
tinue ich those who do and do not con- 
that the h therapy, and follow-up data 50 
ind ma effects of ‘self-improvement of this 
cessful y be compared to the effects of suc- 
Psychotherapy. 


Re 3, 
ceived July 16, 1954 
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Language and the Interpretation of 
“Sexual” Symbolism ' 


Harold H. Mosak 


Roosevelt University 


In current psychoanalytic practice the in- 
terpretation of symbols is accorded two types 
of treatment. Some Psychoanalysts believe 
that certain symbols are fixed symbols while 
others regard these symbols as meaningful 
only when interpreted in the context of the 
individual or group using these symbols, 
Freud advocated the first position in his 
statement that “there are symbols which pre- 
ponderantly, or almost exclusively, designate 

, and there are yet others 
which . . . have only the male or only the 
female signification. To use long, stiff objects 
and weapons as symbols of the female geni- 
tals, or hollow objects . . . as symbols of 
the male genitals is not Permitted by the 
imagination.” 

Freud’s statement would lead us to expect 


that language, also a symbolic form, should 
bear the stamp of these unc i 


“female” 


; symbols are 
designated by masculine articles, 


Spanish as- 
1 An extended report of this study may be ob- 
tained without charge from Harold Mos: 

Flournoy St., Chicago, Ill., or for a fee from the 
American Documentation Institute. 

from the latter source, order Docu: 
from ADI Auxiliary Publications 
duplication Service, Library of Congress, 


r S payable 
to Chief, Photoduplication Service, Library of Con- 


gress. 


pols 
signs feminine articles to 19 male H 
and masculine articles to 12 female Ho for 
In German symbol-gender reversals 0 an ale 
11 of the male symbols and 9 of the S 
symbols. We also note that the dene femi- 
of “long, stiff objects and weapons aline 5 
nine and “hollow objects” as mar No 
indeed “permitted by the imagina a three 
Consistency in gender appears for pols af 
languages. Only 21 of the 59 deri. and 
consistently used with the same ga symbol- 
of these 21, 8 demonstrate consisten nt serr 
gender reversals. These results WATA 1e 
ously questioning whether these sym argue 
either fixed or sexual. It might Pee 
that Freud’s theory of symbols was d 
his expressed feeling that dreams a 
elements are preponderantly visua if 
and therefore would not possess parse con 
with language symbolism. Freud hims etymo 
futes such an argument when he uses ory 
logical evidence to corroborate his the 
dream symbolism. r iga 
In eats of psychotherapeutic investi 
tion such results as ours confront US f 


0 
j 3 ck 
an anomalous situation. For despite la if- 


i 
theoretical foundation or experimental vepe- 
cation, therapeutic techniques may neve ig t 
less prove effective. This effectiveness vidi) 
even be utilized to demonstrate the v2 i he 
of the assumptions underlying the use 0 rely 
technique. Actually, this effectiveness m uê 
demonstrates the utility of the technika 
In the framework of psychoanalytic P 
Freud’s hypothesis might possess such uti ry 
For other schools of Psychotherapy the m 
of fixed sexual symbols would presuma 
Possess little utility or validity. 

Brief Report 
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Co . 
nformance in Role Percept 


ion as 4 Personality 


Variable’ 


Theodore R. Sarbin an 


University of California, 


This stu 
fo she one of a series growing out of 
€mpts ti ological theory of behavior (5); 
Ceptual vari, clarify “conformance,” a Per 
Eon a ale, and throw some light on its 
teow correlates. Š 
y Ptual tata is defined as the modal per 
Be ie parallel nse to a social stimulus object- 
jePlieq to to the notion of conformity as 
in elisha ean conduct. When @ social ob- 
B _ member ualitative perceptual responses 
Bey ja rs of a specified subculture, a 
Pulation rge proportion of the reference 
dn, by as agree on the quality repre- 
th er from ad object; a small number will 
all selves: e majority but will ag n 
No on and a few will agree with VIF 
hicall e. Figure 1 illustrates the notion 
y. 


Frequency of response 
to social object X 


Ki 7 
ind Sad Eager Voin Sly Suspicious 


Fi š 
ig. 1. An illustration of conformance. 


Th 
e sti 
the a material employed jn this study WS 
(qtural ee that developed for a taxonomy © 
$ ues: used in role perception an inferenc® 
prepared a set of 44 schematize 
IN 
o. 7i r 
taking a a series entitled “Contributions to Role- 
Sratitude cory.” The authors wish to express their 
ator nue Professor H. G. Gough, Drs. 
, Albert Kostlan for serving as judges- 


Frank 


d Curtis D. Hardyck 
Berkeley 


n various postures. The figures 
erpretive dancer and represent 
i nd attitudinal states. 
The figures were si d as to offer no cues 


for interpretation other than posture. Figure 2 is 
the Stick Figures Test. 


figures” of humans i 
were drawn by an int 


one of the items in 


44 
___ sleepy 


a thoughtful 


stretching 


— 


sexy pose 


— 


relaxing 


— 


2: Jlustrative item from the Stick Figures Test. 


Fig. 

As a preliminary step 
on 3X5 lantern slides 
division psychology studen! 
the following instructions: 
k figures, representing people 
in various postures, will be shown to you. As the 
figures are shown, you are to write 1 or 2 
adjectives which best describe your impression of 


that figure. 


the figures were presented 
to a group of 150 upper- 
ts. The students were given 


A number of stic 


data obtained in this sample, a 
five adjectives, ranging from most 
frequent to least frequent, was constructed 
for each figure. ‘As no significant sex differ- 
ences were found, men and women were com- 
pined in preparing the check lists. The re- 
liability of the adjective lists was determined 
by taking 4 second sample of 70 upper-divi 
hology students and repeating he 
procedure given above. No significant differ- 


From the 
check list of 
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ences in proportion or kind of adjectives were 
found. : 

In developing norms for the use of the stick 
figures, we noted impressionistically that cer- 
tain persons characteristically selected non- 
modal, i.e., nonconformant responses. From 
these impressions and from certain implied 
postulates of role theory, we were led to the 
following hypothesis: persons who frequently 
make nonconformant perceptual responses are 
characterized by social behavior which is 
deviant or socially invalid. 

The theoretical basis for this hypothesis 
follows from notions originally advanced by 
G. H. Mead (4) and more recently developed 
by the senior author (5). Role perception is 
the first part of a social act; it is the (usually) 
silent naming or locating of the Position of 
the other on the basis of available cues. This 
serves as an aid in locating the Position of 
the self. The motoric response, the role enact- 
ment, follows from the perceptual response. 
Since the perceptual and motoric aspects of 
the social act are acquired holistically, if the 
perceptual response is conformant, then there 
is a high probability of socially valid (though 
not necessarily conforming) role enactment. 
Thus, the veridicality of one’s role perceptions 
bears a positive relationship to functional 
adaptation in the social world. 

Following are reports of three experiments 
which were carried out to test the hypothesis. 


Schizophrenic vs. Normal Responses 


As an initial check on the validity of our 
procedure, the stick figures were administered 
individually to 30 cooperative, undeteriorated, 
hospitalized schizophrenics, They were given 
‘the following instructions: 


A number of stick figures, representing people in 
various postures, will be shown to you. Each ates 
will be numbered, corresponding to a number ae 
this paper. For the corresponding number on this 
paper, there is a list of five words, plus a 
which is left blank. As the figures are sho 
you are to check the word which you 
describes your impression of that figure. 

If the feel that none oF cee ont the “ile 

i our = 
paeguat aT oon coe to be the best EES 
Ke ae marked “other.” 


sixth space 
wn to you, 
think best 


i imi d the experimenter 

me limit was set, an t 1 n 

D Eed to rephrase the instructions if a 
W: 


Theodore R. Sarbin and Curtis D. Hardyck 


subject failed to comprehend the initial in- 
structions. 

The distributions of responses for m 
schizophrenic sample were compared wit 
the norms obtained on our previous samples. 
For the schizophrenic sample the distribu- 
tions were all uniformly rectangular, in om 
parison to the J curves obtained from cole 
normals, thus offering substantial evidea 
for the usefulness of the technique and 
the initial confirmation of the hypothesis. 


> . t 
Conformance Scores and Social Adjustmen 


In the second exploratory study, because of 
practical limitations, we were unable to f 
tain direct behavioral rating such as va 
be obtained in an assessment programa in- 
stead we made use of indirect sources 0 =a 
formation on role enactment. The Cal A 
Psychological Inventory (Gough, 2) Rey, 
number of scales, all of which are empiric is 
rooted in social behavior. This instrument y 
administered to 21 undergraduates who “tiie 
been subjects for the Stick Figures Test. ao 
Inventory profiles were then ranked by hee, 
according to a “social adjustment” crite 

Responses to the stick figures were S 
as follows: The modal response to cach Si 
figure for the previous samples was A nae 
a weight of 1. The subjects were then Si a 
a score in terms of the number of moda oe 
sponse choices made. These scores wa 
ranked and a Spearman rho was compu 
between the stick figure score rankings or 
the ranking on social adjustment. The i, 
relation was .81 (p= :01), a highly sign’ 
cant relationship considering the small num 
ber of subjects. On the basis of the secon 
preliminary study, our hypothesis would see™ 
to be further supported. However, a cross 
validation was indicated owing to the sm 


N and the use of a single judgment of social 
behavior. 


Cross Validation of Conformance and 
Social Adjustment 

The next ste 

the figures to a sample of 91 


Conformance in Role Perception 


oe a measure of personality func- 
an n ‘ e MMPI profiles were sorted by 
tion three judges into a normal distribu- 

on the following criterion of Adjustment: 


Getti $ 
Be g along well in the world as it is. Adequate 
wide ae social conformity; capacity to adapt to 2 
nge of conditions. Ability to fit in (3). 


Ee FEDS were as follows: The range of 
1 to oa the Stick Figures Test was from 
Of the c (44 stick figures). The correlations 
ures Te at Merge scores on the Stick Fig- 
Were 32 at the sorts of the MMPI profiles 
$2 for hese A, .68 for Judge B, and 
Pee of the three sorts to obtain a 
Sulted in € criterion of social adjustment re- 
relation 5 Pearsonian product-moment Cor- 
The aaah 51 with the conformance score. 
m the elation is unusually high, especially 
taining absence of a refined method for ob- 
Sorts ive conformance score.” The above 
parate done with sex groups combined. 
Vealeq © sorts for males and females re- 
Correlati significant differences among the 
lon coefficients. 

etjudge reliabilities on social adjustment 
between Judges A and B, .73 be- 
Ya and C, and .83 between B and C 
eri eat, considered adequate for our X- 
the tal purposes. The split-half reliability 
Yf the Bae Figures Test is .50- Refinement 
tease est by item analysis will doubtless in- 
ore’ reliability. 
ang _telations between conformance score 
tio; Certain clinical scales provide some addi- 
the q, confirmatory evidence. The F scale on 
tjnfre- 


PI indicates the number of “ 
the test. I 


nformance- 


Dostuna, the F scale tend to P 
dex €s in a nonconformant wa 
fali Of social maladjustment 7S t a 
Subj nica] scales:on. the MM PION MaS oye 
Ret’s score is two sigmas oF MON 
: il on- 
fo = View of the method used to obtain fine or 
Shona è score, the possibility ae 4 ats ae the 
to, AR unt. SC 
tions aken into acce nificant tendency tonara 
tvi inearit revealed B Sin safe to conclude, me 
be> that E we a t of conformance p 
RT a ENR me tionship t° Jevel of adjustmen 
Mea. cant rela! z ofle Soris. 
Sured by the MMPI P 
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the mean. This index correlates with con- 
formance — .33 (and was probably used im- 
plicitly by all the judges in making their judg- 
ments of social adjustment). An empirically 
devised scale of ego strength (1) correlates 
.50 with conformance.* 


Summary 


On the basis of certain postulates derived 
from role theory, 2 significant relationship 
between nonconformant perceptual responses 
and deviant social behavior is hypothesized. 
Three experiments were performed to test 
this hypothesis. The first experiment com- 
pared the distribution of responses of nor- 
mals and schizophrenics to a set of schema- 
tized stick figures of humans in various 
postures. The normal subjects were found to 
have J-curve distributions as contrasted with 
the rectangular distributions of the schizo- 
phrenic sample. ; 

In a second experiment, the number of 
t responses of a group of normal 
subjects was found to bear a significant re- 
Jationship to their social adjustment as judged 
by test profiles. A third, cross-validational, 
experiment indicated the stability of the re- 
lationship. Correlations with certain empiri- 
cally derived personality scales offer further 
confirmation of the hypothesis. 


12, 1954. 


conforman 
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The Rorschach Experience Balance in Epileptics 


Paul W. Pruyser? and Angela T. Folsom 


The National Veterans Epilepsy Center, Boston 


The Rorschach literature contains several 
observations of abnormalities in the use of the 
human movement and color determinants by 
epileptics. Rorschach (9), using mostly de- 
teriorated epileptics, reported an underpro- 
duction of M in slowly dementing patients 
and a marked Overproduction of M in the 
most demented ones and concluded that the 
quantity of M in an epileptic record is pro- 
portional to the degree of dementia. Ror- 
schach described an overemphasis on the color 
determinants, also increasing with the degree 
of dementia, and often formed by the use of 
many pure C responses, including the so- 
called color-naming (Cn) response. Since the 
publication of Rorschach’s manual several 
workers have Partially or wholly corroborated 
his findings, except for his observation that 
the degree of M increases with more pro- 
nounced dementia. In intramural as well as 
extramural groups of epileptics the finding 
of low M is general (1, 4, 6, 7, 10, 12, 13) 
and several workers have confirmed the no- 
tion of a typically epileptic, extratensive ex- 
perience balance (EB). A disproportionate 
emphasis on color, usually with predomi- 
nance of pure C and CF over FC has been 
found to contribute to the extratensive tend- 
ency (1, 4, 10, 12). These indices have also 
been used to validate the old, widespread 
notion of the so-called “emotional explosive- 
ness” of epileptics and have even served as 
an aid in diagnosing epileptics from Ror- 
schach records (5). As a matter of fact, it 
appears that Rorschach’s own use of the find- 
ings of the predominance of unformed color 
in his group of epileptics played a role in de- 
fining the diagnostic meaning of the CF and 
C responses as indicating emotional explosive- 
ness (9, Tables I-VII and XII). Obviously, 


1Now at Topeka State Hospital, Topeka, Kansas. 


ses 

this part of the validation of color mi 
is based upon a circular argument rets 
starts with a clinical notion and ies i- 
the meaning of an abnormal test i Oe e 
rectly in terms of that clinical = 
even before it is systematically verified. of 

Studies of the intellectual inacn o if- 
epileptics have shown that samples fror giv 
ferent strata of the epileptic populate ee 
very different results. For instance, sine on 
testing of institutionalized patients sho sples 
the whole a subnormal range of IQ’s, pen 
of extramural patients have yielded a f the 
IQ and a range comparable to those 0 
normal, nonepileptic population (3, ar se- 
reasonable to assume, therefore, that t Ror- 
lection of samples may also affect the EE 
schach findings, the more so since it $ B 
now well established that the ireguency Q 
M responses is positively correlated lation 
level. To what extent the normal corre ` epi- 
between IQ and amount of M holds for 
leptics is as yet unclear, since accurate liet 
on IQ’s are lacking in several of the eee 
Rorschach publications. With few eat on 
(6, 7, 13), most authors have publishe i 
deteriorated and/or institutionalized grate 
or on samples with an abnormal proportion 
below average IQ’s. 


Jt is 


Present Study 


The present study offers EB data on ‘ 
group of 136 male epileptic veterans, all F 
tramural patients, who were hospitalized 0? J 
for diagnostic study and medical treatme” 


T mean age is 31 (range 
21-52). In the vast majority the epileptic 
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Ss 


od 


Rorschach Experience Balance in Epileptics 


symptoms made their first appearance after 


adolescence. The group permits the following 
Subdivisions: 


22 
15 
23 


w idiopathic grand mal epilepsy 
mite idiopathic psychomotor epilepsy 

1 idiopathic grand mal and psychomotor epi- 
39 PSY 
9 a symptomatic grand mal epilepsy 
8 with symptomatic psychomotor epilepsy 

Symptomatic grand mal and psychomotor 

epilepsy 


pent to assess the generality of the 
eis, Teported abnormalities in the EB 
€ptics, which is the purpose of this 

2 Y, we propose: 
Btoup mial comparison of our ie 
tellectual stande ileptic group of normal in 


ee ; 
Ponents of hy ee analysis of the com- 


The Results 
Beck of lication of Rorschach norms by 
ble, Pro: a. (2), based upon the Spiegel sam- 
statistien S a useful frame of reference for 
“ults al comparison. Table 1 shows the re- 
Siena comparison between Beck’s group 
the det als and our group of epileptics for 
uce fy q inants which constitute the experi- 
alance, In order to cope with the gross 


Comp, i Table 1 
artison of EB Determinants in 136 Epileptics 
and Beck’s Normals 


N below N above 
M combined combined 
Ca; group group 
— etna median ? 
Nor 
> mals 111 001 
Po "lentes 03 43 
Nor, 
Rp nals 113 01 
Cr Ebileptics A A 
Norm 2-.01 
als 5 102 .02-: 
C Tpileptics Pa 70 
Nor o1 
poe 57 
Epilene 100 
Sum Cileptics 105 27 d 
Normals 47 110 .02- 
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Table 2 


Frequency of Each Number of M, FC, CF, and C 
Responses in 136 Epileptics 


Response 
Frequency M FC CF C 
0 37 62 66 109 
1 56 42 43 18 
2 15 13 11 2 
3 18 10 8 6 
4 5 6 4 1 
5 3 3 3 0 
6 1 0 0 0 
7 1 0 0 0 
8 0 0 1 0 


deviations from the normal distribution curve 
which characterize most Rorschach scores the 
following procedure was adopted: a median 
score was computed for the two groups com- 
bined? and this score was taken as the cut- 
ting point for the development of a 2 X 2 
table containing for each group the number 
of cases falling below and above that point. 
The p values derived from a chi-square test 
would then indicate to what extent the null 
hypothesis, in this case whether the two 
groups could be seen as samples from the 
same population, was tenable. The table gives 
the relevant figures and indicates that sig- 
nificant differences exist between the two 
groups. For both movement and color re- 
sponses the epileptic group shows a striking 
underproductivity, which contrasts with previ- 
ously reported findings of an overuse of color 
by epileptics as 4 group. l 

As an introduction to a further analysis of 
these data we specify in Table 2 the fre- 
quencies for each number of M, FC, CF, and 
C responses for the total epileptic group. In- 
spection of the figures shows that there is a 
sharp increase in the zero category if one 
moves from M, through FC and CF, to C. 
To assess these data properly and to deal 
with the possible influence of R, we employed 
the measure 12% as introduced by Rapaport 


2 We express our indebtedness to Drs. Donald W. 
Fiske and Samuel J. Beck of the University of Chi- 
cago. The former was kind enough to furnish the 
raw scores of the Spiegel sample which enabled the 
use of distribution-free statistics. 
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Table 3 
i» MQ in 136 Epileptics and Beck’s Normals 


Group 
Frequency 
(Gn oe cent) Idio- Sympto- ; All z . 
in each { pathic matic epileptics Normals 
class | (V=60) (V=76) (N=136) (V=157) 
On ; 32 24 27 15) 
1-20 iS 5 5 2 
21-40 20 18 19 18 
41-60 12 22 18 23 
61-80! = 15 17 16 24 
81-100 § «n> 17 13 15 18 


et al. (8). It is based on the formula 


M 
M + Sum C X 109 


computed for each record separately, express- 
ing in the range 0-50 a color prevalence, and 
in the 51-100 range a movement prevalence. 
Values between 40% and 60% can be taken 
as without clear-cut prevalence in either di- 
rection. Table 3 shows the percentage of cases 
falling in each of five intervals of an M% 
scale, with the corresponding figures of Beck’s 
normal group for comparison. For the epi- 
leptic group as a whole, 51% of all cases 
seem to show color predominance, against 
31% with a movement predominance. The 
first figure, however, includes cases in which 
the M% was zero as a result of total absence 
of M. In such cases the M% is not a fair 
index and should not be used; when we ex- 
clude these cases from the color-predominant 
group, only 24% of all cases have a clear-cut 
color prevalence in the range from 1 to 40. 
Such a low incidence of color prevalence in 
our group is in sharp contrast to earlier re- 
ports in the literature which show a general 
predominance of color responses for epilep- 
tics. Moreover, a further analysis of those 
cases which have an M% from 0 to 40 shows 
that 53% of them had no M, and 40% had 
only one M, whereas only 7% had two or 
more M. In other words, in the Majority of 
cases with a seeming predominance of color 
the real abnormality lies in a marked under- 
production of M rather than in any overpro- 
duction of C, CF, or FC. A comparison of the 
distributions of the total epileptic with the 


Paul W. Pruyser and Angela T. Folsom 


normal group by means of chi square (based 
on the raw data instead of the percela 
shown in the table) yields a p between ‘ 
and .05. a 

A more familiar approach to EB lies in z 
signing each case to one of the following fou 
categories, as recently more clearly define 
by Stotsky (11): 


one 
1. Coarcted: if both M and Sum C are equal to 
or less r 
ate 
2. Ambiequal: if either M or Sum C are a is 
than one and the difference between tl 


one or less c plus 
3. Introversive: if M is greater than Sum 

one Jus 
4. Extratensive: if Sum C is greater than mP 

one 


Table 4 gives the percentages of cases a 
ing in each of these categories, as comp ‘6: 
to the normal group. Extratensive cases j 
only 28% of the total group (comparab 
the 26% of the normal group), whereas 4 
coarcted and ambiequal cases, which show 5, 
prevalence in either direction, constitute (as 
gether more than half of the total sample one 
against only 35% of the normals). If the 
further takes notice of the fact that in als 
EB classification the extratensive grouP M 
contains a number of cases with only on@ ~,’ 
it appears that the notion of color predo 
nance in the Rorschach records of epileP 
as a group finds no support in these data 
Statistical check with the normal group ta 
means of chi square (based on the raw the 
instead of the percentages shown in the 
table) indicates a difference significant at ae 
1% level, mostly due to the predominance ip 
coarcted and the relative absence of int! 
versive cases in our sample. re- 

It has been said (1, 4, 9) that color P 
dominance in epileptics takes the form 0 


the 


tics 


Table 4 i 
A . 5 
EB Classification of 136 Epileptics and Beck’s Norm® 
Idio-  Sympto- All 
pathic matic epileptics Normi ae 
EB %o o % 2: 
Coarcted 35 33 34 12 
Ambiequal 20 21 21 23 
Introversive 18 17 17 39 
Extratensive 27 29 28 26 


Rorschach Experience Balance in Epileptics 


Table 5 


c X z š 
omparison of Idiopathic and Symptomatic Epileptics 


Idiopathic Symptomatic 


Rorschach (V=60) (NV =76) 
actor Median Median p 
Determinant: 
a a 63 50 
Cr AS 68 .01-.02 
C At 61 -10-.20 
S 33 30 .50-.70 
um C 50 64 -20 
M% 33.32 42.26 .50-.70 
Number Number 
EB class: 
Soareted 21 25 
mbiequal 12 16 
Introversive T 13 .20-.30 
“xtratensive 16 22 


di " 
exes Portion within Sum C, consisting of an 
One a Pure C and CF responses over FG: 
aS at Table 2 shows that this ob- 
“Pics on does not hold for our group of epi- 
De (7, 10, 12) have pointed out that 
Sist În gj the pure color responses may CON- 
€spon, simple color naming, the so-called Cn 
Ses. They occurred in 10 cases OF 790 
= Whole group. 
reported” of the fact that others (10) have 
Scores differences in various Rorschac’ 
lepticg i idiopathic and symptomatic epi- 
the mein also compared these two groups on 
Sults in measures used in this study. The te- 
frequ are brought together in Table 5. The 
Rot €Ncy distributions of the two groups o 
Which iffer appreciably, except for C a 
th ont symptomatic group scores higher. 
and 4, 1,0 represent the more typical case, 
erpro show once more the trend toward pa 
£ ose UCtivity on either side of the p KE 
35 th to publish the median values in Ae 
about. Preceding tables contain indicati 
the spread of the scores. 


Discussion 


The findings here reported are f 


It to throw 
Consi e 3 


de lity of in- 
fer erable doubt upon the genera i y 

Benes made from earlier studies which ae 
on ed an overemphasis on color, Cage y 
h Pure C and CF, in epileptics. On the other 


ad they confirm once more the earlier find- 
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ings of low M in epileptic records. Our analy- 
sis has shown, moreover, that in several cases 
the impression of an apparent emphasis on 
color is based on the artifact produced by a 
scarcity or even total absence of M. For the 
sample of epileptics we used, then, the out- 
standing feature of the EB is one of under- 


. productivity on both sides. 


Since our sample differs from those of many 
previous workers in intellectual level and 
range among other things, the conclusion 
suggests itself that the general mental status 
of epileptics (which largely determines in- 
stitutionalization or extramural care) is an 
important factor in regulating the use of 
color in the Rorschach test. Guirdham (4) 
also called attention to this factor, but he 
still held to the finding of an imbalance within 
Sum C consisting in a relative neglect of FC 
in favor of CF and C. This phenomenon is 
not typical of our group. 

The idea of a typical emotional explosive- 
ness of epileptics, which seemed to have re- 
ceived some corroboration from earlier studies 
(mainly with institutionalized patients), would 
thus appear in need of experimental support. 
And such support should preferably not come 
from test scores with an insufficiently defined 
meaning in which the clinical impression itself 
functions as an interpretative factor. 

‘An intellectually average group of epilep- 
tics, such as our sample, seems to yield a 
variety of EB types in which constrictive 
tendencies predominate. The observed varia- 
bility ties in well with the growing conviction 
among epileptologists that personality dis- 
turbances in epileptics do not follow one 
typical pattern, but are multifactorial with 
a considerable tendency toward constriction. 
A narrowing of the scope of functioning is 
found in many groups of afflicted persons and 
is an earmark of general neuroticism. 

Since coarctation on the Rorschach test 
may be related to R, the data were also 
analyzed in terms of a split between a low 
(R, 0-24) and a high (R, 25 or more) pro- 
ductivity group, each compared with the 
analogous subdivision of the normal group. 
The trend of the differences was found to lie 
in the same direction. For M, the difference 
between epileptics and normals remained sig- 
nificant in the high as well as in the low 
productivity group; for C, a significant dif- 
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ference was found in the high productivity 
group. 


Conclusions 


1. There is a significant difference in the 
EB of normal subjects and of an extramural, 
nondeteriorated group of epileptic veterans 
who show underproductivity in all deter- 
minants of the EB. 

2. In contrast to the bulk of previous 
studies on epileptics, which point to a pre- 
dominance of extratensive EB’s, this extra- 
mural, nondeteriorated group of epileptics 
yields a variety of EB types in which con- 
strictive tendencies predominate. Generaliza- 
tions about “epileptics” from the Rorschach 
EB become thus a hazardous undertaking. 

3. In many cases the impression of an ap- 
parent emphasis on color is based upon an 
artifact, produced by a scarcity or even total 
absence of movement responses in epileptics. 

4. No significant differences in the crucial 
determinants of the EB (M, pure C, Sum C) 
are found between idiopathic and symptomatic 
epileptics (both nondeteriorated, extramural, 
male veterans). 

5. In view of earlier publications relating 
aberrations in the use of the Rorschach color 
determinants to emotional explosiveness of 
epileptics, one is thus forced to select one of 
the following alternatives: 

a. One retains the clinical notion of the 
emotional explosiveness of epileptics, but 
then the unformed color determinant of the 


Rorschach test does not appear to be a valid 
measure of this trait. 


b. One accepts the diagnos 
unformed color in the Rorschach test as emo- 
tional explosiveness, but then the correspond- 


ing personality trait would not appear typical 
of epileptics. 


tic meaning of 


Summary 


The Rorschach EB data of 136 extramural, 
intellectually grossly intact epileptic veterans 
were compared with those of Beck’s normal 
controls. In all determinants of the EB the 
epileptics showed a significant underproduc- 
tivity. The majority had a coarcted or 
ambiequal EB, whereas in many cases the im- 
pression of an apparent emphasis on color 
was based on an artifact produced by scarcity 
or absence of movement responses. These 
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facts contrast with repeated statements in the 
literature that emotional explosiveness (aS 
measured by an extratensive EB) is a ae 
cally epileptic character trait. It is conclut 
that either: (a) all epileptics are emotionally 
explosive, but Rorschach’s CF and C do no 
measure it; or (b) CF and C are valid in 
dicators of emotional explosiveness, but i 
leptics as a group are not characterized by 
this trait. 


Received July 20, 1954. 
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A Note on Some Projected Familial Attitudes 
Associated with Rorschach Movement Responses 


Jerome L. Singer 


Franklin D. Roosevelt VA Hospital, Montrose, 


New York 


and Daniel A. Sugarman 


Teachers 


ol y . 
or Sue represents a partial replication 
Which iv bie an investigation by Shatin (5) 

ematic ries comparison of Rorschach and 
teported th pperception Test variables. Shatin 
between hat a significant association emerged 
ovement a number of Rorschach human 
tion of responses (M) and the designa- 
“benign parental figures on the TAT as 
COnsisted 5 nurturant.” His subject sample 
cently of 90 psychoneurotic patients. Re- 
dat, 24 increasing body of experimental 


ata 
Diti has tended hach’ Ac 
trica] ed to support Rorschach’s en 
S otor 


hibits 
an 

ther a d fantasy or imaginative 
tot > 7, 8). Shatin’s finding offers a clue 


ied also who form numerous M responses 
nign o t° describe parental figures as more 
ks i € can speculate that individual dif- 
in fantasy or delaying capacity may 

ech eir origin in differing patterns of par- 
relationships. Perhaps the child who 
Dey et some sense of security in his de- 
é relationship with one oF both parents 
dy se oe capable of restraining motor Te- 
Uring q ected toward gratification of needs 
me temporary absence of the parent. 
fan asi estraint might be accomplished by 
the €d identification with the activity ° 
iste ult, In the case of the relatively CoM” 
a benign parents the assurance © 
y turn may reinforce the 
and the employment of fan 


0 A 
rary substitute. However tentative suc 


College, Columbia University 


ulation, it seems worth while to at- 
to confirm Shatin’s finding 
bjects and another nosologi- 


a form 
tempt at least 
using different su 


cal group. 
The principal hypothesis of the present 


study is that schizophrenic adults differing in 
production of Rorschach M differ predictably 
in their descriptions of parent-child relation- 
ships and parent identifications in Thematic 
Apperception Test stories. Specifically, it is 
hypothesized that patients designated as 
members of a High-M group attribute rela- 
tively more positive qualities to parental fig- 
ures, identify adult figures more often as par- 
ents, and ascribe more positive features to the 
jnterpersonal relationship of parent and child 


than do Low-M patients. 
Procedure 


th Rorschach and TAT protocols were 
om 60 hospitalized veterans diag- 
nosed as schizophrenics. The Ss were divided 
into two groups, High-M and Low-M, using 
the production of two or more M as the cut- 
off point. The two groups did not differ sig- 
nificantly in other Rorschach scores nor in 
ertinent background factors, including age, 
IQ, diagnostic group, duration of illness, and 
educational experience. A further description 
of this sample was presented in connection 
with a previous study (7). 

To insure relative objectivity all TAT 
protocols were analyzed in accordance with a 
scheme described in previous studies (3, 6). 
Only Cards 1, 2, 6BM, and 7BM of the TAT 
were included. The rating of the protocols was 


Bo 
obtained fr 
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carried out by the authors independently 
without knowledge of Ss’ Rorschach group. 
Since scoring called only for judgments of the 
presence or absence of certain qualities, chi 
square was employed as a test of significance 
of the association between distributions of 
pertinent TAT ratings for the High- and 
Low-M groups. 


Results 


1. On Card 2BM (“Farm Scene”), High-M 
Ss showed a slight trend in more frequently 
designating the right-hand female figure as 
“Mother.” (x? = 2.2; p/2 = .08) 

2. On Card 6BM (“Mother-Son”), Low-M 
Ss more frequently failed to designate the fe- 
male figure as “Mother.” (x? = 3.2; p/2< 
05 > .02) 

3. Both High- and Low-M Ss did not differ 
in designating the “mother-figure” on Card 
6BM as “cold or rebuking.” Since 85% of the 
total sample so designated the “mother-fig- 
ure,” little discrimination could be expected 
here. 

4. High-1 Ss described the atmosphere 
of the interpersonal relationship between 
“mother-figure” and son on Card 6BM more 
often as “warm” or Possessing some positive 
elements and less often as “cold” than did 
the Low-M Ss. (x2 = 5.9; p/2 < 01) 

5. High-I Ss more often ascribed purely 
Positive qualities to the “father-figure” on 
Card 7BM than did Low-M Ss. (x? = 4.4; 
p/2< 03> .01) 

6. High-M Ss described the atmosphere of 
the father-son interpersonal relationship more 
often as “warm” or Possessing positive ele- 
ments and less often as “cold” or “neutral” 

than did Low-M Ss. (x? = 4.1; p/2 = 02) 

7. No differences emerged in ratings of 

“means-end cognizance” or in the nature of 
problems discussed on the four cards. 


Discussion 


The results in general seem to confirm the 
hypothesis and are in accord with Shatin’s 
findings for a neurotic sample. Since it must 
be remembered that these schizophrenics pre- 
sent considerable discord in the interpersonal 
relationships depicted in their Stories, the 
finding of differences on this dimension be- 
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tween High- and Low-M Ss is all the we 
striking. As a matter of fact, these results fa 
of interest because they tend also to 0 ; 
with a different sample further support E 
conclusions reached in an earlier study ro. 
paring projected familial attitudes of SC is 
phrenics and normals (6). Although Ta 
class status was not studied here (most rder- 
this group being of lower-middle or Eir 
line status) the marked tendency for Eo 
phrenics to ascribe more rejection and ! nal 
tive characteristics to parents is borne a 
again in this sample. Little change in per ots 
ages from those reported for the pre 
sample of 60 schizophrenics emerged. ental 
The generally negative view of pa the 
figures appearing in TAT protocols re, oe 
schizophrenics is modified in part in t pac 
ords of patients with two or more Rola 0 
M responses. Pending further verinoa rmal 
this result with other samples and 2 final 
groups, it seems premature to draw any © 
conclusions. Nevertheless, an avenue ° ir 
ploration into possible genetic factors di 
volved in the M response and the genera “i 
mension of motor inhibition and fantasy saa 
to beckon. These findings suggest taa ng 
bility that some persons have develope! figures 
standing positive fantasies of parental Taye 
which sustain them during periods of de fi 
gratification. The results reported her al 
consistent with views expressed by Mor 
(4) and by various psychoanalytic tie the 
(1) that socialization or the evolution 0 a 
reality principle in ego development iS des 
lated to incorporation of parental attitu 
through positive identifications with adults: 


Summary and Conclusions 


This investigation was designed to test Mi 
a different sample and nosological group tic 
finding reported by Shatin (5) that neuro 
Ss with relatively numerous Rorschach Gi 
tended to portray parental figures in 


stories as “benign or nurturant.” A sample ° 
60 hospitalized 


divided into High- and Low-4z 


ee 


Projected Familial Attitudes and Rorschach 


or ihe « characteristics ascribed to parents 
lationshi — S of the parent-child re- 
tended me esults revealed that High-M Ss 
maded more frequently to identify older fe 
either — as mother and generally ascribed 
tive Ae o more positive or less nega- 
Personal a to fathers or to the inter- 
children y ah between parents and 
ese schiz these cards. The marked trend for 
ures as Pae Ss to perceive mother fig- 
tive char or rejecting and to ascribe nega- 
ica oe generally to parent-child 
earlier rm in their stories confirms an 
tients (6) We with another sample of pa- 
Negative tr Despite this general assignment of 
ence of aits to parental figures, the emer- 
characterj i ger more positive parental 
Confirms mad in the stories of High-M Ss 
a fruitful atin’s results. It is suggested that 
€ gene „approach to the understanding of 
M and the and evolution of the Rorschach 
may es capacity to delay overt response 
Olve exploration of the atmosphere of 


y 
Y parent-child relationships. 
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Relationship Between Diagnostic Category and 
Deviant Verbalizations on the Rorschach 


William T. Powers and Roy M. Hamlin 


Western Psychiatric Institute, University of Pittsburgh 


In a study of pathological thinking in the 
Rorschach, Watkins and Stauffacher (6) 
compared 25 normals, 25 neurotics, and 25 
schizophrenics on the basis of their “delta 
scores.” The authors used a modification of 
Rapaport’s types of deviant verbalizations on 
the Rorschach, which were felt by Rapaport 
to be more or less indicative of the presence 
of schizophrenia, and assigned quantitative 
values to various types of deviant responses. 
Watkins and Stauffacher obtained these values 
by having each author arbitrarily and inde- 
pendently assign, to each class of responses, 
a value which he felt to be appropriate on 
the basis of his experience. The specific values 
ranged from .25 for mildly pathological re- 
sponses, through .50 for moderately patho- 
logical responses, to 1.00 for very pathologi- 
cal responses. Having developed this scoring 
procedure, they then proceeded to score, in- 
dependently, the 75 Rorschach protocols 
used in their study. In order to equate for 
different length of protocols, they divided the 
total score for each protocol by the total 
number of responses in the Protocol. In each 
case, this figure was then multiplied by 100 
to obtain the delta score for the protocol. 
The average delta scores for the normal, neu- 
rotic, and psychotic groups were respectively 
2, 4, and 18; and ¢-test comparisons signifi- 
cantly differentiated the normal group from 
the neurotic group and the neurotic group 
from the psychotic group at the .01 level of 
confidence. Watkins and Stauffacher report a 
scoring reliability coefficient of .78, highly 
significant, which is based on total scores for 
all 75 records. 

The present paper reports results obtained 
with the method of scoring developed by 


Watkins and Stauffacher. The outside ciy 
terion in this case consisted of five clinica 
groups, two of them nonschizophrenic, an 
the other three schizoid or schizophrenic. ^- 
specific point of interest in planning the pe 
ent study was the relative efficiency of Wal 
kins and Stauffacher’s scores as compar 
with scores of formal Rorschach element 
“sign” scores, and clinicians’ judgments. Bri 
comment will be made on this point 12 t 
Discussion. F 

The hypothesis tested in this study wo 
Watkins and Stauffacher’s scores show 4 5! 
nificant correlation with the five clinics 
groups, representing degrees of psycholos!© 
disorganization. 


Method 


Fifty subjects were used, 10 in each of p 
groups. The first group consisted of 10 ia 
cially adjusted subjects. Each of the ot oF 
four groups may be labeled with a ce a 
sis. However, diagnostic label was never P 
cepted as a sufficient criterion for inclus! 
in a group. For example, group 4 consiste 
of 10 patients with a diagnosis of parano’ 
schizophrenia. Each case record was studie 
carefully to insure that these 10 subjects M° 
the following criteria: agreement on diag- 
nosis over a reasonable period of time; defi- 
nitely elicitable delusions; ideas of referenc? 
or hallucinations; a history of inadequate 
sexual adjustment; and a record of instances 
in which the subject indulged in bizarre 
behavior. The paranoid schizophrenic grouP 
was differentiated from the catatonic schizo- 
Phrenic group by the absence of mutism 
posturing, and other catatonic symptoms, 
with these factors in turn Operating as cri- 
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teria for inclusion in the catatonic schizo- 
phrenic group. 
— of the other four groups, including 
= ss was screened with equal care 
tie = fear. was selected for inclusion in 
i... y before taking the Rorschach. This 
eis wer insured somewhat more homoge- 
the ea meaningful clinical categories than 
E critical use of diagnostic labels. A sec- 
5 a was to minimize contamination; 
a, may be diagnosed as a paranoid 
Sey hrenic partly because of his Ror- 
esa Every effort was made to include in 
zal riteria for a group only acceptable clini- 

evidence and observation that could 
ardly come from the Rorschach itself. 

he five groups were: 


. Socially adjusted subjects 
. Anxiety neurotics 

3. “Latent” schizophrenics 
4. Paranoid schizophrenics 
5. Catatonic schizophrenics 


N= 


Essentially, these five groups Were selected 


phra present a rough continuum of “gchizo- 
Port's. disorganization, in line with Rapa- 
chara, _Gescription of deviant responses aS 
g on of schizophrenia. However, a 
an S group was included, sincè Watkins 
Obtain auffacher found that neurotic subjects 
T s higher deviant response Scores than 
Brou qaubiects. The inclusion of & neurotic 
Simila “oes not imply any assumption of basic 
e ity between neurosis and schizophrenia. 
*es one thesis tested was that these deviant 
Cho} © Scores are related to levels of PSY- 
gical disorder or disorganization. 
las € catatonic schizophrenics were placed 
of thes the list of five groups 0” the pass 
that g ltation with psychiatrists, suggesting 
term, CY Might show more disorganization ! 
chiz of deviant responses than parano! 
pphrenics. 
ates Scoring used in this stu 
aig and Stauffacher’s procedure n a 
Schac S. In the present study, eac ef 
aS to Protocol was typed, and informa et 
Was gn20 Sex, and education of the SU j 
8lven at the top of the protocol. In the 


dy followed 


Scor % 
ent k 8 of each record, then, it seems appar 
Spon, t the score assigned to any given Te 

ed by the 


o; 
nse by a judge may be influenci 
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opinion which the judge has concerning the 
previous responses which he has scored in 
this same record. In other words, each re- 
sponse was not evaluated in vacuo but in the 
context of all other responses in a given 
protocol since the scorer always had the total 
Rorschach before him. This may possibly be 
a weakness in the method of scoring, but does 
bring the procedure closer to a “global” ap- 


proach. 
Results 


Validity. The mean delta scores which 
Watkins and Stauffacher obtained for their 
normal, neurotic, and psychotic groups were, 
respectively, 2, 4, and 18. In the present 
study, the mean delta scores for the nor- 
mal, neurotic, latent schizophrenic, paranoid 
schizophrenic, and catatonic schizophrenic 
groups were, respectively, 6, 11, 21, 21, and 
34. It is apparent that the mean delta scores 
in the present study are higher than those re- 
ported by Watkins and Stauffacher. The or- 
der of groups was exactly as predicted, al- 
though the difference between the latent 
schizophrenic and paranoid schizophrenic 
groups was minimal. An analysis of variance 
design was used and the F ratio was 6.2. An 
F ratio of 3.8 is significant at the .01 level 
for 4 and 45 degrees of freedom. An epsilon 
coefficient, OY corrected eta, was also com- 


Table 1 


Number of Cases Falling in the Scoring 
Categories Indicated 


Para- Cata- 
Anxiety Pre- noid tonic 
Delta Nor- neu- schizo- schizo- schizo- 
scores mals rotics phrenics phrenics phrenics 
Above 50 1 1 
45-49 
40-44 1 1 2 
35-39 1 2 
30-34 1 
25-29 1 
20-24 1 2 
15-19 3 1 3 2 
10-14 1 1 4 1 1 
59 5 6 1 2 L 
04 4 
Mean 5.62 11.40 20.53 21.00 33.50 
SD 2.71 464 1159 13.50 21.57 
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puted. This value was .65, a highly signifi- 
cant figure. 

Table 1 shows the distribution of the sub- 
jects in the five groups with respect to their 
delta scores. The mean and standard devia- 
tion of each group are also indicated. Inspec- 
tion of this table suggests cutoff points at 
scores 10 and 20. Only one subject, or 10%, 
of the normal group scored higher than 10, 
whereas 80% to 90% of each of the psy- 
chotic groups scored above 10. However, 40% 
of the neurotic group obtained scores above 
this cutoff point. A cutoff point at score 20 
shows no normal or neurotic subjects obtain- 
ing higher scores, whereas 40% to 60% of 
each psychotic group scored above this point. 
Table 2 indicates the percentage of cases in 
each group falling above the selected cutoff 


scores. 
Table 2 


Percentage of Cases in Each Group Falling Above 
the Indicated Delta Scores 


Para- Cata- 
Anxiety Pre- noid tonic 
Delta Nor- neu- schizo- schizo- schizo- 
score mals rotics phrenics phrenics phrenics 
Above 20 0 0 40 40 60 
Above10 10. 40 90 80 90 


= ae 


Any practical value that such cutoff points 
might have is, however, contingent upon 
strict consistency of scoring. The delta scores 
in the present study show a constant trend 
toward relatively higher values than those 
reported by Watkins and Stauffacher. This 
difference in scores is reflected in their. sug- 
gested cutoff points at scores 5 and 10. Care- 
ful standard training of scorers is, of course, 
indicated, but there is also apparent need for 
further refinement and specification of scor- 
ing categories. 

Scoring reliability. In Watkins and Stauf- 
facher’s study, the reliability of Scoring co- 
efficient, based on total scores, for all 75 
records was .78, a highly significant figure. 
In the present study, only one author scored 
all 50 Rorschachs. Fifteen protocols were se- 
lected at random and scored by the second 
author to provide an estimate of reliability. 
Each scorer worked independently, after care- 
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ful review of Watkins and Stauffacher’s defi 
nitions and examples of the various ae 
categories. A product-moment correlation RS 
efficient was computed on the basis on e, 
total scores assigned to each of these 15 i 
schachs. The obtained value of .88 suppa 
the result obtained by Watkins and Sta 
facher. oto: 
When the specific responses in each pr aie 
col are considered, however, the sa a 
less satisfactory. The total number i 
sponses in all 15 protocols amounted to H 
Of this total, one author scored 133 respo 
while the second scored 142 responses. ve 
total number of jointly scored respons y 
87, with the percentage of agreement slig er- 
over 60. In the individual protocols the K ; 
centage of agreement ranged from 50 tO pen 
The results are even less satisfactory 4 Te 
the categories to which the jointly ato dom 
sponses were assigned are considered. Se 
was a jointly scored response assigne d 
exactly the same category by both ju ate’ 
These results suggest that the scoring Be | 
gories should be more adequately delim! in 
and those categories which are extremely dif- 
reliable or which serve little function ad pe 
ferentiating degrees of pathology shou 
eliminated or at least modified. dered 
Watkins and Stauffacher have consid?!” 
the problem of consistent scoring in Ri 
tail, and their data point to the same di tjon 
ties suggested here. One important indica Te 
from their results should be repeated: the ith 
liability of scoring increases consistently W! J 
degree of psychological disorganization. Ak 
cifically, they report separate scoring ike 
abilities for their 25 normal, 25 neurotic, 4! è 
25 psychotic subjects. These coefficients Wer 
respectively: .04, 47, and .91. Although ae 
increasing reliability is related simply to Oy 
increasing magnitude of scores in the mo 
pathological groups, two other factors shou j 
be considered. First, the “mildly deviant A 
Sponses, as specified at present, may be Wê 
nigh impossible to score with any suitable de- 
gree of reliability. Second, in both studies: 
the scorers worked with the entire protoc? 
before them, not with one strictly isolate 
response at a time. The higher reliability for 
the more pathological groups may reflect 
global estimates of the Rorschachs, guided 
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y eg attention to one response at a 
scorers he tendency, or constant error, of the 
hes a the present study to obtain higher 
a those reported by Watkins and 
erati acher may be related to these consid- 
ations. 

oe of these scoring problems, it is 
petits la clear that encouraging coeffi- 
Teliabilit correlation were obtained for both 
total aie of scoring and for validity when 
Correct} res were used in conjunction with a 
tespo on factor for variability in number of 

nses, and when each independent worker 


Scored 
all record i i given 
treatment, s considered in any & 


Discussion 


Pecific focus of interest in undertak- 
© present study was the relation of 
He and Stauffacher’s method to other 
es ents of Rorschach data. The delta 
ae here are superficially similar to 
Jüdgm ach sign or determinant scores, oF tO 
rial ents of small units of Rorschach ma- 
o Actually the delta scores represent @ 
d the midway between the sign approac\ 
Spr Use of global judgments. Hamlin (4) 
Studie, ‘viously reported on a series of L 
Îudgme using variously the sig”, small unit 
The Seat and global judgment approaches: 
call Studies suggested that small, mechani- 
egati ed or judged units tend to give 
u tive results when correlated against an 
ent © criterion, and also that global judg 
S tend to give negative results when the 


ateri 
best “al to be judged is too complet E 


situa results seem to be obtained i a 
Useg lons where larger units than signs E 
Cien? 28d where samples of behavior SU x 
tio to represent some degree of organi 
are used so that a clinical judgmer in 
le rather than a mechanical sco"! 


Ut a ration: 
ale. $ 
h he method followed with the delta a F 
€ present study incorpora 
of interest in this respect- 
always worked uses © eention Was 
S . . 
ior Ed to a small unit of projective fae. 
Rack single Rorschach response; ee Z ali 
unj, SCOre or judgment was made on A con- 

of material, but in the more é 


The 
in S 
atki 

Teat 
Cor, 
A or, 
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text of a total Rorschach. Third, the scoring 
involved an underlying rationale based on 
Rapaport’s formulations. Thus, the scorer had 
a series of feasible tasks, each in a larger 
configurational context, and knew what he 
was doing in terms of a meaningful rationale. 

The results suggest that these conditions 
contribute to an encouraging degree of cor- 
relation with an outside criterion of psycho- 
logical disorganization. For example, as a 
rough indication, the obtained epsilon coeffi- 
cient of .65 compares favorably with the 
values of .47 and .50 cited by Hamlin (4) 
from two studies (1, 3) where the outside cri- 
terion groups (representing degrees of psy- 
chopathology) and the variable judged (over- 
all adjustment) were somewhat similar. The 
correlation of .68 cited from another study 
(2), where Wechsler-Bellevue IQ was the 
outside criterion, is not significantly higher. 

The general questions underlying this and 
the other studies mentioned have been: under 
what conditions can clinicians make valid 
judgments from projective material? and 
how do successful judges proceed in making 
predictions? The possible practical value of 
such scales as Watkins and Stauffacher’s for 
routine clinical use is questionable. Tech- 
niques like the Rorschach will continue to be 
used as Clinical tools without being reduced 
to an intricate variety of objectively scored 
scales. The study of judgments and of con- 
ditions necessary for successful judgments 
may, however, clarify the efficiency of pro- 
jective procedures. 


Summary 


The hypothesis tested in this study, that 
Watkins and Stauffacher’s delta scores will 
show a significant correlation with the five 
diagnostic groups, was upheld. The F ratio 
of 6.2 and the epsilon value of .65 were both 
significant at the .01 level, as was also the 
'g8 scoring reliability coefficient obtained 
from a comparison of total scores assigned 
by the two authors to 15 jointly scored pro- 
tocols. 

The significant results were in keeping with 
the results obtained by Cummings (3), Albee 
and Hamlin (1), and Watkins and Stauf- 
facher (6) in similar studies, and the meth- 
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ods used in the present study resembled the 
methods used in those studies. 

In all of these studies, as opposed to less 
successful judgment studies, the scorer or 
judge dealt with small units of material and 
made judgments based on a specific rationale. 
The procedure of allowing the judges to have 
the complete Rorschach protocols before them 
while evaluating the specific responses gives 
the added advantage of allowing the judge to 
gain an over-all impression of the record, 
while at the same time his forced considera- 
tion of each individual response insures that 
his final judgment of the protocol will by no 


means issue solely from his opinion of the 
total gestalt. 


Received August 5, 1954. 
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Anxi 
Ways, a a been measured in a variety of 
among mea ere is little general agreement 
disagreement is 1 A possible source of this 
volved in = the methodological problems 
encountered i aluating anxiety. The problems 
Primarily thes measuring clinical anxiety are 
°c e e a dennition and reliability 
Sa AEDA Because the term “anxiety” 
tational Ae. of behavioral referents, the op- 
chavi efinition should be explicit, and 
ecified iors labelled “anxious” should be 
Clinica] » When anxious behavior is rated in 
Judges cay ons, there should be several 
Ment, nd a statement of interjudge agree- 
Tw è 
Solving Previous studies illustrate attempts at 
attempt these problems. Gleser and Ulett 
Which ed to measure “anxiety-proneness,’ 
Status Was defined as “the present mental 
ad pe past history of anxiety, background 
dicate p Pality development that would in- 
2 streg, Be occurrence of anxiety symptoms in 
trist = ul situation” (4, p- 280). A psychia- 
Scale nd a psychologist used an eight-point 
ter Ti rate anxiety-proneness. The inter- 
nor abilities were .51 for patients and .30 
nner tates Elizur defined anxiety aS an 
Yt mor tate of insecurity which may take one 
lag ee of the following forms: fears, phobias, 
of re Self-confidence, extreme shyness, ideas 
24g) ‘tence, and marked sensitivity” (3, P 
lege $ rom protocols of interviews wi h col- 
Mgs on dents three judges made anxiety rat- 
Tater . 2 Rine-point scale. The average inter- 
Correlation was .70. 
evaluating these two studies it may be 


ph 
ay as abn 
nd study was carried out with the permis ie 


D en 
Piiters Souragement of Juul Nielson, p 
tona, Te indebted to Drs. Charles Windle and 
] reading of 


rd i 
“ye for their critica 


seen that Elizur’s definition of anxiety is more 
specific than that of Gleser and Ulett. This 
was evidently reflected in a considerably 
higher interjudge reliability in rating anxiety 
in normals: .70 for Elizur and .30 for Gleser 
and Ulett. It seems likely that further speci- 
ficity in defining anxious behaviors would 
yield still higher interjudge reliability and 
would prove more useful in future research in 
this area. If reliability can be established, the 
obtained measure could be used as a criterion 
for validating other measures, such as anxiety 


questionnaires. 
Purpose 


s of this paper were: (a) To 


The purpose 
attempt a clear delineation of various mani- 
festations of anxiety and to determine if this 


results in higher interrater reliability; (b) to 
elationship of each manifesta- 


determine the T! 
tion of anxiety to a global evaluation of anx- 
jety; (c) to use the ratings of anxiety as a 


criterion against which to validate the Taylor 
Scale of Manifest Anxiety (A scale) (7). 


Method 


Subjects. The Ss were patients in a neuro- 
psychiatric hospital. Patients were excluded 
from the study for the following reasons: 
(a) out of contact, (6) on electroshock or 
insulin therapy, (c) low intelligence, (d) 

brain damage. Seventy- 


diagnosed organic 
three patients (33 men, 40 women) were in- 
terviewed, and 64 of these completed the A 


scale. Of the nine Ss who failed to complete 
the A scale, several stopped in the middle and 
refused to go OM, and the remainder com- 
plained of being ill. 

Procedure. Each S was interviewed in a 
room with four psychologists, who served as 
judges. A pilot study had indicated that the 
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presence of additional persons in the inter- 
viewing room did not markedly affect S’s 
anxiety level. Patients in this hospital are 
frequently seen by several members of the 
staff simultaneously. Each S was interviewed 
by the same psychologist, although the other 
three psychologists also asked questions at 
the end of the interview. The interview lasted 
approximately 15 minutes. Then the S was 
conducted to another room, and the A scale 
was administered by another staff member. 
Immediately after the interview, each judge 
rated S for anxiety. Each rating was made 
independently and without consultation with 
the other judges. 

The interview. The interview was relatively 
uniform. The interviewer introduced himself 
and then the other three judges to S. At first 
all questions were open-ended and unstruc- 
tured, e.g., “What has been bothering you?” 
“What happened?” “How do you feel in- 
side?” As the interview progressed, the ques- 
tions became more specific and direct, e.g., 
“Do you have aches and pains?” “Do you 
have trouble sleeping?” “Does your heart 
beat fast?” At the end of the interview, the 
interviewer asked the other judges if they 
had any questions to ask. Finally, S was 
given the task of subtracting sevens from 100, 
and the interview was ended. 

The ratings. Although definitions of anxiety 
in psychiatric and abnormal psychology texts 
(1, 2, 5, 6, 8) vary, there tends to be general 
agreement on the manifestations of anxiety. 
attempt was made to use 
tations of anxiety on which 
there is general agreement. It was decided to 
group symptoms into categories because the 
probability of occurrence of any given symp- 
tom, e.g., excessive Sweating, in any given S 
was small. Each category was rated on a five- 
point scale: a rating of 1 represented absence 
of or minimal manifestation, and a rating of 
5 represented maximal manifestation, 

The categories were divided into behavior 
observed and behavior reported by the pa- 
tient in the situation, as follows: 


A. Observed 


1. Distractibility. It was found in the Pilot study 
that distractibility per se was difficult to rate. 
Therefore a task was introduced, the task of sub- 
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tracting sevens from one hundred. Serial subtaeam 
is typically used in psychiatric settings as a ba 
of distractibility. Inattentivencss during the Eo 
view was also taken into account in rating 
category. i 

2. Restlessness. This category involved the s 
components of anxiety: agitation, tremors, ani A 
It was arbitrarily decided to rate at least 4 (on io 
five-point scale) for the presence of tremor ani 
rate 5 for marked tremor. a 

3. Physiological concomitants. This category i 
volved the autonomic components of anxiety. hing) 
manifestations were selected: sweating, flus! 
breathing disturbance, and excessive swallows à 
rating was based on both intensity and num 
symptoms. 


B. Reported 


4. Subjective feeling of tenseness. This catea 
referred to the patient’s report of how much the in- 
bothered or upset. The rating was based on aint. 
tensity, frequency, and chronicity of the Cor 
It was arbitrarily decided that the verbalizati 
Panic would be rated 5. a 

5. Worry. This category referred to apprehena 
regardless of whether there was a basis in fa con- 
was arbitrarily decided to rate 2 if S’s WO rat- 
cerned only money or leaving the hospital. T 
ing was based on intensity and chronicity- d to 

6. Somatic complaints. This category referret al 
aches, pains, and peculiar feelings exclusive of 3 r 
illness, e.g., gallstones, arthritis, or heart disen 
though somatic delusions were included. The T and 
were based on the number, frequency, intensity» 
chronicity of the complaints. in- 

7. Physiological concomitants. This catego alo 
volved the same manifestations as observed Pi ita- 
logical concomitants, with the addition of PaP ple 
tion. It might be expected that the obser rte 
concomitants would be the same as the repo 
concomitants. However, it was demonstrated in 
pilot study that these two categories were one 
identical; several patients reported physiological crew 
comitants without manifesting them in the interv 
situation. the 

8. Muscular tension. This category involved it 
same manifestations as observed restlessness; ‘rst 
the addition of a feeling of internal tension. At ical 
glance, muscular tension may appear to be identi as 
with subjective feelings of tenseness. However, of 
defined in this study, it referred to an awareness 1 
muscular contraction that was reported as “tied E 
in knots,” “ready to explode,” “feel shaky.” T! A 
may be contrasted with the reports on subjectiv' 
feelings of tenseness: “nervous,” “upset,” “stirred UP 
inside,” “panicky.” 

9. Over-all rating of anxiety. This category refers 
to a global estimate of anxiety. The’ ratings were 
based on what may be termed a clinical impressio” 
of anxiety. The judges attempted to divorce this 


rating from any particular category or configuration 
of categories. 


sion, 
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Results 
The anxiety ratings of each judge were 


į Compared with those of every other judge. 


í 


Jooo 


RE each of the nine categories there 
etween correlations.* The mean correlations 
column: judges are shown in the first two 
83 ets at Table 1. The mean correlation of 
Cates aie Judges for over-all anxiety indi- 
Agen y high interrater reliability. 
what ratings for distractibility appear some- 
Other as reliable than the ratings in the 
Was pa egotie The rating for distractibility 
ance ee largely on the patient’s perform- 
num E the task of subtracting sevens. The 
aken t of errors and the amount of time 
tive A perform this task are fairly objec- 
the hi asures, which probably accounts for 
igh reliability. 

fear tings for observed physiological con- 
e rating orn, somewhat less reliable than 
e Beinn, of the other categories. This may 
Ervin, ibed to a fundamental difficulty im ob- 
deth, autonomic changes. Changes in the 
but e and rate of breathing are discernible, 
lowin anges in sweating, flushing, and swal- 
tice, 8 are often so minimal as to escape DO” 
Yield, € ratings for the remaining categories 
{tg Mean jintercorrelations that range 

4 relinha 85, indicating a moderate ge 
“xiety, ility in assessing these aspec 


Com; 


s of manifest 


e ej egs : 
anyje, ought ind gorje: 
xi ividual categ f their ex 


Dect,” Were selected on the basis 0 
Ner to relationships to global anxiety. In a 
ings in vermine these relationships the na 
Comp, cach category were pooled s ee 


é è -al 
anien a with the pooled ratings of ver 


toy, Y» The correlations, shown in h 
efinig, OF Table “Ty indicate that there iS $ 
ing Ite relationship between the over-all tai. 
Vidya ĉMxiety and the ratings in P% pange 
ftom Category. While the correlations $ ‘ 
tween +”, to .72, there is little differen Sger- 
Neeg adjacent correlation: an quctuation 


May be ascribed to cha” a 
rome Forrelations in this study are Pearson P 
transf ”’s; the correlations Were a 
2y mation method. hat the best 
tlima ems reasonable to assume, i category is 
the of cach S’s rating for any EY" ke rat 


Con; A fore t! 
Bs of ensus of the four judges, There hese pooled 
âtinp. the judges were averaged, $ mparisons. 


Were used in all subsequent © 
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Table 1 n 


Intercorrelations Among Judges, and the Correlations 
of the Ratings with Over-all Anxiety and 
with the Taylor A Scale 


Intercorrela- Corre- Corre- 
tionamong lation lation 
judges with with 
— over-all A 
Category Mean Range rating scale 
Observed 
1. Distractibility 93 .92-.94 AT 16 
2. Restlessness 74 68-80 66 37 
3. Physiological con- 
comitants 56 .41-.65 56 „24 
Reported 
4. Subjective feelings 
of tenseness 66 .59-.77 .65 52 
5. Worry 16 .71-.79 50 50 
6. Somatic complaints .85 .81-.88 52 40 
7. Physiological con- 
comitants 81 .76-.86 .72 68 
8. Muscular tension -713 67-77 68 4 
9, Over-all rating of 
anxiety .83 .66-.92 60 


There were two categories of physiological 
concomitants, one observed and one reported. 
It might be expected that there would be a 
“halo-effect,” resulting in a high degree of re- 
lationship between these categories. However, 
the correlation is .30, indicating a rather low 
degree of relationship. Evidently, S’s report 
of autonomic disturbance differed from what 
the judges observed in the interview situa- 
tion. 

Similarly, restlessness and muscular tension 
referred to essentially the same manifesta- 
tions of anxiety, the former observed and the 
latter reported. The correlation between rat- 
ings in these categories is .61, indicating a 
definite relationship. Evidently there is a 
r correspondence between observed and 


greate! r 
reported skeletal symptoms than there is 
between observed and reported autonomic 
symptoms. 


Next, the pooled ratings for each category 
and for the over-all rating of anxiety were 
compared with the Taylor A-scale scores. 
The correlations are shown in the last column 
of Table 1. There is a low relationship be- 
tween the A scale and the observed categories 
and a moderate relationship between the A 
scale and the reported categories. The corre- 
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lation for reported physiological concomitants 
was somewhat higher than that for the other 
categories, which suggests that there are 
many items of this sort in the A scale. The 
over-all rating of anxiety correlated .60 with 
the A scale, which suggests that the A scale 
measures many of the same kinds of behavior 
as the ratings do. 

The over-all rating of anxiety was a “clini- 
cal” integration of the eight categories of 
anxious behavior. Integration may also be 
obtained by arithmetic summation of the 
ratings in each category; the pooled ratings 
for categories 1 to 8 were added to yield a 
single score for each S. The correlation be- 
tween these arithmetic sums and the over-all 
ratings is .93, which suggests that there is 
little difference between arithmetic and clini- 
cal integration. The arithmetic sums of each 
judge were correlated with those of every 
other judge. The mean intercorrelation is 88, 
and the range is .81 to .91. The correlation 
between the pooled arithmetic sums and A- 
scale scores is .64. This is not significantly 
different from the correlation of .60 between 
the over-all ratings and A-scale scores. 


Discussion 


In this study clear delineation of the mani- 
festations of anxiety resulted in reliable rat- 
ings. The average intercorrelation between 
judges of .83 may be compared to the cor- 
relation of .51 obtained by Gleser and Ulett 
(4) on their ratings of patients. With normal 
subjects Elizur (3) obtained an average in- 
terjudge correlation of -70, while that of 


Gleser and Ulett was .30. Both Elizur’s defi- ~ 


nition and the present one were more spe- 
cific than that of Gleser and Ulett. Thus, it 
may be concluded that specificity of defini- 
tion increases interjudge reliability in the 
measurement of anxiety. 

It has been assumed heretofore that the 
various aspects of anxiety must be integrated 
more or less intuitively in order to obtain a 
global measure of anxiety. This procedure 
was followed in the present study, in which 
an over-all clinical rating of anxiety was made 
by each psychologist. A likely basis for as- 
suming the necessity of such intuitive inte- 
gration is that there must be an implicit 
“weighting” of the various aspects of anxiety. 


A. H. Buss, M. Wiener, A. Durkee, and M. Baer 


The psychologist is expected to use his a 
cal judgment in deciding which aspects 4 


A ; : ion 
more important in any given S. The quest! 


arises as to the advantages of clinical nea 
tion over mere arithmetic summation. peas 
sults showed an extremely high relations 
between these two types of integration s y 
that arithmetic summation yields Sier 
higher interjudge reliability. Apparently, OF 
cal integration offers no advantages om 
arithmetic summation. Thus, it may be rious 
cluded that specific denotation of the v4 wi: 
manifestations of anxiety, followed by § ae 
mation of the ratings, yields an adequate, eat 
liable measure of anxiety. It would pe 
that there is no necessity for vaguenes 
defining or measuring anxiety. 
The manifestations of anxiety 
most texts include both observed ae in 
ported behavior. The definition of ane A 
this study included both aspects. T type 
flected in the relationship between eac ting: 
of behavior and the over-all clinical "4 a 
The correlations between the ratings o ical 
observed categories and the over-all ca 
rating were of approximately the same, the 
as the correlations between the ratings f0 ting: 
reported categories and the over-all ra Ke 
Thus the over-all rating did take into 
count both types of behavior. ToO 
Since the clinical evaluation of anxiety ‘et 
formed to a consensual definition of ae 
and proved to be reliable, it was used 4 
criterion measure. The A scale showé' the 
moderately high relationship to both Jini- 
arithmetic summation and the over-all ae 
cal estimate of anxiety. The A scale shove 
a much higher relationship to the TER Oba 
categories than to the observed categori 
This was expected because the A scale ©? i 
sists only of self-ratings, i.e., reported ante 
festations of anxiety. Anxious behaviors cr 
served by others are omitted. To the exté jy 
that the A scale omits items that relate t 
observed measures of anxiety, it does 20 
completely measure anxiety, as defined bY 
Psychiatric and abnormal psychology texts: 
However, the A scale’s relationship to the 


criterion suggests that it is a fairly adequate 
measure of anxiety. 


It should be possible to construct an anx- 
iety inventory with an extremely high rela- 


listed #” 
dre 


OO > T 
~ E 
CUO e ee 

at eS 


Measurement of Anxiety in Clinical Situations 


tionshi 
A mo an external criterion. This might 
the 4 al, performing an item analysis on 
lect high. , using the clinical ratings to se- 
uch an ae and low-anxious subjects. 
ithe See would provide a quantita- 
aant of anxiety, as defined clinically. 
age over present-day anxiety in- 


Ventorie: 
. ES, whi e Ig 
obvious, ” hich have only face validity, is 


Summary 


This 

Ñ 

(as denea S, attempted to evaluate anxiety 

tion and rel y textbooks) in a clinical situa- 
ate this measure to anxiety as 


Measur 

ed 

Anxiety, oy the Taylor Scale of Manifest 
ients wers o enty-three neuropsychiatric pa- 


: he a terviewed, and 64 of these com- 
the Various a. scale. Four judges rated the Ss 
f intervi Spects of anxiety on the basis of 
Ollows, OW material. The results were as 


l. Specs 
Be ity denotation of the manifestations 
fa “Cline suted in reliable ratings. 
* to yie an integration of anxious behav- 
a global measure of anxiety COT- 
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related .93 with mere arithmetic summation 


of the various manifestations. 
3. The correlation between the over-all 
rating of anxiety and A-scale scores was .60. 


Received July 29, 1954. 
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Cross Validation of the Organic Brain Pathology 
Scale for a Test of Symbol Arrangement’ 


Theodore C. Kahn 
USAF School of Aviation Medicine, Randolph Air Force Base, Texas 


The validation of the organic brain pa- 
thology scale of a technique which requires 
the subject to arrange 15 plastic objects sev- 
eral times on a segmented strip appeared in 
1951 (1). The objects used in the test vary 
in color, size, and thickness, and their shapes 
represent easily recognized symbols which 
are common in our culture. The administra- 
tion takes approximately 15 minutes and the 
scoring a like amount of time. In the origi- 
nal study 50 patients with a diagnosis of or- 
ganic brain pathology were matched with a 
non-brain-damaged group. In that study 197 
variables were statistically evaluated and 99 
of these were found to be significant. The 
difference of the means yielded a ¢ ratio of 
17.6 when the distributions of the scores of 
the two groups were compared. 

Thirty patients in a state mental hospital 
who had a diagnosis of organic brain pa- 
thology and whose medical histories roughly 
corresponded to the previous patient group 
were matched in age, IQ, educational level, 
race, sex, religion, and national origin with a 
non-brain-damaged group of like size. The 
screening of the control group was carried on 
under the supervision of a Psychiatrist. Fac- 
tors which were not equated and which were 
significantly different in the two groups were 
the number of subjects who had been veter- 
ans, the number who lived in rural versus 
urban environment, occupational level, and 
marital status. 


1An extended report of this study may be ob- 
tained without charge from Major T. C, Kahn, 
USAF School of Aviation Medicine, Randolph Field, 
Texas, or for a fee from the American Documenta. 
tion Institute. To obtain it from the latter source, 
order Document No. 4482 from ADI Auxiliary Pub- 
lications Project, Photoduplication Service, Library 
of Congress, Washington 25, D. C., remitting in ad- 
vance $1.25 for microfilm or $1.25 for Photocopies, 
Make checks payable to Chief, Photoduplication 
Service, Library of Congress. 


All of the scores of the new organic gro 
fell within the range of scores previously i 
tablished by the first organic group with Pr 
exception that one patient scored lora 
(away from normal) than had any of ise 
organics in the previous testing. Likena 
the scores of the new non-brain-damag 
group fell within the range of scores y the 
first non-brain-damaged group except tha ears 
score of one subject, who was over 75 E 
old, fell somewhat outside of this range ean 
the direction of the organic group. The ee 
score of the new organic group was — ain- 
with a o of 110.9; that of the no A 
damaged control group was + 34.6 Ta the 
of 65.2. The difference of the means ie of 
scores of the two groups yielded a ¢ ei: 
11.1. Since the analysis of variance pro ont 
a significant F ratio, the medians were © Ci 
pared by chi square and the difference 0! 
found to be significant at better than the - 
level. r 

Cutoff scores were established for the P 
groups in the two studies. If three subi aa 
over 70 years old are excluded from the 2 
non—-brain-damaged groups, a cutoff SCO 
— 54 would separate 92 per cent of the 2 
organic group, and 100 per cent of the seca 
organic group, from all the non-brain-dan a 
aged subjects in both groups. Even W 
these three low scoring subjects are include® 
a cutoff score of — 138 separates all the ee 
brain-damaged subjects in the two studie 
from 72 per cent of the first organic grouP 
and from 83 per cent of the second organic 
group. 


Brief Report 
Received January 12, 1955. 
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Digit Symbol Performance as a Function of Increasing 
Levels of Anxiety 


Joseph D. Matarazzo and Jeanne S. Phillips 


Division of Psychosomatic 
Washington 


In i 
significa, elier studies (2, 3) we reported a 
Performanc curvilinear relationship between 
anxiety leye in a timed learning situation and 
of Manife nas measured by the Taylor Scale 
Significant Anxiety (A scale) (6, 7), and a 
anxiety Je Hi pe relationship between 
imed ae and intelligence as measured by 
S desig telligence test. The present study 
loying gned to extend these findings by em- 
ol te learning task, the Digit Sym- 
bee em itution test, which in the past has 
and as Ployed both as a measure of learning 
tion H intelligence subtest. With the tradi- 
ab este nocedure the 67-item Digit Symbol 
extended» the Wechsler-Bellevue (10) was 
She siq to 175 items. These were printed on 
S ber of a sheet of paper. The time limit 
The qi fased from 114 minutes to 3 minutes. 
i used were the standard ones: 
Ss Was group administration, a total of 119 
clude Used in the experiment. This number 
Student, an entire class of first-year medical 
hap oS (W = 81) and approximately one- 
Wa the sophomore class (N = 38). It 


i 
Stu eared before the experiment that oF 
digit had had previous experience with the 
xcluded from 


te wae task and he was © 
Ss i 99. The A scale was administered to al 
Mediately following the learning task- 
digit 3 hypothesis to be investigated was that 
ting r Ymbol performance wou 
‘ety, relationship to increasin 
WYlus n the basis of the results of t 2 
linear A%e study (3), we predicted @ curvi- 
Mtiteri relationship based on the following 
Hen (a) a U-shaped curve as determined 
silon a inspection, (b) a higher value © 
n than z and a correspondingly sig- 


he earlier 


Medicine and Department of Neuropsychiatry, 
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nificant value for the chi-square test of line- 
arity of regression, and (c) a significant dif- 
ference between the means of groups 1 and 
2, 1 and 3,1 and 4, 1 and 5, 3 and 6, and 3 
and 7. These differences in means for specific 
groups (criterion c) were predicted on the 
basis of the significant differences obtained for 
the time criterion in the original study. It 
was realized at the outset that these predic- 
tions were contingent upon the way in which 
Ss of the present study distributed them- 
selves in groups according to their Taylor raw 
scores. If an insufficient number of Ss fell in 
any group; predictions about that group would 


necessarily no longer be valid. 
Results 


e basis of their Taylor raw scores the 
were assigned, as in our previous 
to groups on a scale of increasing 
anxiety level. Individuals with raw scores of 
1-5 were given an anxiety rating of 1, while 
those with raw scores of 6-10, 11-15, 16-20, 
etc., were given ratings of 2, 3, 4, etc., re- 
spectively- While the over-all distribution of 
Taylor raw scores for Ss of this study (rang- 
ing from 1-35, mean of 12) was similar to 
that reported by Taylor (7) and also to that 
found with the maze and intelligence data, 
the number of Ss in each subgroup (especially 
the groups at the high end) differed slightly 
from our previous findings. Thus, only 11 Ss 


earned Taylor raw scores above 21 (five from 
from 26-30, and two from 31- 


On th 
119 Ss 
studies, 


21-25, four 
35). In an effort to avoid the problems im- 
hese small N’s, the 11 Ss were 


posed by t 
her. This left five groups: group 


grouped toget! 
1 included raw scores 1-5, and individuals 
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with raw scores of 6-10, 11-15, 16-20, and 
21-35 were placed in anxiety groups 2, 3, 4, 
and 5. The number of Ss in each of these 
five groups from low to high was 18, 41, 34, 
15, and 11, respectively. 

Before the mean digit symbol performance 
of each of these five groups was computed, 
criterion c of the original prediction was 
changed to conform to these findings. The 
prediction was now changed to read: based on 
the results of the maze study, the following 
groups will be expected to differ significantly: 
1-2, 1-3, 1—4, and 1-5. Although groups 3-5 
did not differ significantly in the earlier study 
(groups 3-6 and groups 3-7 did), it is pos- 
sible that 3-5 will differ in this study since 
group 5 now includes Ss with raw scores 
ranging from 21-35, and thus overlaps groups 
5, 6, and 7 of the previous study. 

The mean digit symbol scores for each of 
the five groups are shown in Fig. 1. The 
values from low to high anxiety are: 101.8, 
109.7, 109.8, 108.8, and 106.4. These values 
and visual inspection of the curve confirm 
criterion @ of our hypothesis, i.e., that the 
function is a U-shaped curve. Two aspects of 
the curve are worth noting: (a) as with the 
time measure of the maze data, the largest 
mean difference is found between groups 1 
and 2, and (b) the failure of the curve to 
make a complete U at the high end. This 


o 

2 109 

= 

< 

S107 

a 

=) 

o 105 

o 

= 

> 

v 103 

E 

o 

5 101 
1 2 3 4 ra 
ANXIETY LEVEL 


Fig. 1. Mean digit symbol score for each of the 
five groups ranging from low anxiety (group 1) to 
high anxiety (group 5). 
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latter may be a function of the unfortina’ 
restriction in the number of groups at t 
high end. 

Since the data in Fig. 1 represent only E 
means of the learning scores in each of ma 
five groups, the confirmation of the hypo 
sis, by visual inspection alone, is not poss! a 
This is especially true since there was nan 
siderable variability in learning score Tae 
individual to individual within each o le 
five groups (the sigma was roughly ° 
order of 15 for each of the five groups): i 

Criteria b and c were next applied. P 
the two previous studies (2, 3) the 4- ons 
value of 1.02 was not significant. The ree 
for this are discussed in the earlier Sa $ 
and involve the fact that there may aria- 
functional relationship between the two viety 
bles (digit symbol performance and ra are 
level) and that the five anxiety group” tial 
not “independent” but ordered in a EENT ane 
relationship to each other. This cel not 
may increase the “within” variance whi This 
influencing the “between” variance. spility 
whole problem, as well as the pers e 
of using ¢ tests with data of this type ae 
absence of a significant F, has been disc 
by Webb and Lemmon (8, 9). the 

Analyses of the differences berna ai that 
means for the various groups reveale wer 
two of the four differences predicted ad 
statistically demonstrated: groups 1- ly at 
1-3 were each found to differ significant Y ing 
the .03 level of confidence. The rera 
two differences, between groups 1—4 and pe- 
were not demonstrated. The difference 
tween groups 1—4 was just short of the + 
level, however. 3-5 

The additional prediction, that groups oi 
might possibly differ significantly, did mA 
hold. Despite the relatively moderate Mê 
difference between these two groups, ch 
in Fig. 1, the intragroup variability was SU‘ 5 
that the difference was not statistically S!8 
nificant. This finding is unfortunate for 4 
hypothesis since it was the only differenC 
(due to the restricted number of Ss at 
high end) predicted between the high an 
middle ranges of the anxiety continuum. Co?” 
sequently, criterion c for the establishment ° 
a curvilinear relationship between digit sy™- 
bol performance and increasing levels of anx- 


i 


Digit Symbol Performance and Levels of Anxiety 


iet; 

a Was Bot confirmed. That it would have 
groups at ths yee we had had two additional 
Conjecture. a igh end is a matter simply for 

s in the Saas demonstrated superiority of 
ae. Ange af ee ee 2 
group 1, is e to Ss in the low anxiety group, 

s ase nevertheless a significant finding.* 
studies, — out in the two previous 
e relation ka meaningful determination of 
under discus ip between the two variables 
technique ssion is the use of correlational 
low dete S (criterion b). These methods al- 

a nation of the strength of the re- 
tion Pit, shown in Fig. 1. Both the correla- 
Unbiased Conctane’ PP: 259-261), and the 
eee oe ation ratio, epsilon (4, pp. 319- 
Variance ee from the analysis of 
and ieee of both of these measures (.20 
Significance spectively) did not reach statistical 
zero, This and therefore do not differ from 
ftom the = finding, which is unlike the ae 
ee € Maze study, is surprising in view 0 
the panty between our ii Fig. 1 and 
aze ae curve relating time to learn the 
arson ne Anxiety level. The value of the 
nee mele found to be an insignificant 05. 
Significa er correlation ratio is statistically 
Chis nt, it was not possible to apply the 
p. 3) wate test of linearity of regression 4, 
the try in order to determine whether or not 

€ function deviates from a straight line. 
Discussion 


One ; 
limits ot thus forced to conclude, within the 
curvi; these data, that the hypothesis of a 
k Nin: ĉar relationship betwee? digit symbo 
With 8 and increasing levels of anxiet¥— 
hot j°Ptimal learning in the middle range—is 
to p Mne out. The hypothesis is supported 
© extent that the relationship between 
Was gv anxious and middle anxious groups 


Tela, monstrated, but the equally important 
middi, nship (for the hypothesis) between 
despi Stoup and the high anxi 
Sut, eee trend in means, Was 
Pre. e failure to demonstrate 
Sent task even the low-order, piney 


l 
Consi ii tud: 
the ~OBsistent with the finding of our maa re 


Show, Comprisin, ups o 
g the five groups | 

deter, ; no differences in mean intelligence cote = 

mined by the CVS abbreviated intelligence Scale: 
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theless significant, correlations attained in the 
earlier studies, in view of the mean differences 
shown in Fig. 1, poses a question regarding 
the “meaning” of these same differences and 
also of the numerous similar ones reported 
in other studies using the A scale. 

That there are, in fact, true differences in 
conditioning and learning abilities of Ss who 
differ in Taylor anxiety score has been dem- 
onstrated many times.? The present study 
adds to this growing literature. However, 
the equally important finding of low correla- 
tions (when these have been computed) be- 
tween anxiety level and performance in vari- 
ous situations implies what has long been 
known, that factors other than anxiety, Or 
intelligence for that matter, are involved in 


learning ability. Accordingly, correlational 
in the 


techniques would appear necessary 
design of future studies utilizing the Taylor 
scale. ; 


Summary 


On the basis of previous work, a curvilinear 


relationship was predicted between Digit 


Symbol performance and score on the Taylor 
Scale of Manifest Anxiety. A total of 119 Ss 
was divided into five groups ranging from 
low to high anxiety. The prediction was borne 
out in part, the performance of the middle 
groups being superior to that of Ss in the low 
anxious group but, despite a trend in the 
predicted direction, the hypothesis was not 
confirmed for the middle and high anxious 
groups. The strength of the relationship, how- 
ever, was found by correlational techniques 
to be an insignificant one. A methodological 
question regarding the use of the Taylor scale 
was raised, i.e., the need to include correla- 
tional methods of analysis in future studies 
because of the low-order relationships ob- 


tained in studies to date. 
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The Disctiminative Power of the Strauss-Lehtinen 
Battery in Adult Mental Patients’ 


A. A. Rafi 


Netherne Hospital, Surrey, England 


an ey experiments have been reported 
Searches i subjects that duplicate the re- 

ildren % Strauss and Lehtinen (1) with 
Pacity of hese authors emphasize the ca- 
Tals — battery to discriminate nor- 
exogenou ogenous mental defectives, and 
qQuantit, s mental defectives þut offer no 

tative evidence. 

i be sean investigation aimed at deter- 
a statisti ether the battery discriminated to 
analogous 7 significant extent adults of 
al S categories, i.e., bright and dull 

eee without brain damage, men- 
o eee and brain-damaged persons. 
analysis istical techniques were employed: 

9 estab of variance by double classification 

lish the general effect of diagnostic 


and 

Si Š 

ex differences on the separate tests of 
nction analy- 


h which the 
particular 


tal 


-e ba 

SIS to ery, and discriminant fu 
Whole he the efficiency wit 
Categories CY distinguished the 


Method 


Th 
Proced test material, instructions, and testing 
` Ees were modeled on those described 
Boarg XSS and Lehtinen (1)- The Marble- 


arı . 
d, Figure-Background, and Tactual-Mo- 
e following 


e: z 
Manners’ were quantified in th 


udenberg, PHY- 


rs Biyge’tintendent, Netherne Hospital, for facili- 
Cobertson to carry out this research, an d 
Urage, n, senior psychologist there for his en- 
p Thanks at and guidance. 
Physician Wwe also extended to Drs. 
Re A. Wouperintendent, St. Lawrence’s 
va Shital alk, physician superintendent, 
alidati, » for additional cases to make uP the cross- 
ng samples. 


Marble-Board Test (six patterns—maximum score 
18) 


Score 

3 constructive performance of pattern; 

2 orderly continuous sequence along outline of pat- 
tern; 

1 discontinuous, sporadic perform: 


similar to pattern; 
0 discontinuous, incoherent, sporadic performance 


with outline dissimilar to pattern. 


ance with outline 


Figure-Background Test (nine items—maximum 


score 27) 


Score 
3 correct namin; 


9 
background; 
2 noting presence of object in vague, imprecise 


manner as “round thing,” “long thing”; 

1 mentioning both object and background but im- 
precisely, €-8- “scribbling with something round 
in the middle”; 

describing background, n 


g of object with no reference to 


ot mentioning object. 


0 

Tactual-Motor Test (three items—maximum score 
nine) 

Score 

3 figure only; 

2 figure with contour of board; 

1 figure and background; 

0 background only. 
The behaviors scored O are stated to be 

characteristic of brain-injured children (1). 
The Dot-Perseveration Test was also ad- 

ministered, but perseveration appeared too 


dequate quantification in meas- 
urement terms and when treated enumera- 
tively the differences were not statistically 
This test was dropped from the 


rarely for a 


significant. 
battery. 

All the subjects were inpatients at Netherne 
Hospital. Each sample of the categories 


d 20 subjects, 10 males and 


studied comprise 
distributions as follows: 


10 females with age 
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bright mental patients, mean 47.7, SD 9.47; 
dull mental patients, mean 45.7, SD 11.23; 
certified mental defectives, mean 34.2, SD 
12.03; and brain-damaged patients, mean 
50.2, SD 11.78. The first two categories were 
described psychiatrically as well-behaved 
chronic patients on parole. The allocation 
into bright or dull was made on the basis of 
Wechsler vocabulary raw scores, the limits of 
the bright category being 27.5 to the maxi- 
mum, those of the dull category 18.5 to 22. 
None of the certified mental defectives had a 
Wechsler vocabulary raw score above 15. The 
neurological classification of the brain-dam- 
aged sample was as follows: paresis, five 
males and two females; cerebral atrophy, 
three males and four females; secondary 
cerebral carcinoma, one male; Huntington’s 
chorea, four females; head injury, one male. 

When the test results had been scored by 
the writer, they were independently scored 
by another, person (not a psychologist) who 
was provided only with the actual results and 
the scoring instructions. There was only a 
very small proportion of disagreements; the 
product-moment correlation exceeded .90 for 
each test, using the difference method. 


į Results 


Table 1 summarizes the results of the 
analyses of variance. It is clear that there are 
statistically significant differences among the 
categories in performance on each test. The 
factor of sex influenced only one test and that 


to a limited extent. The effect of the inter- ` 


action was negligible. 
In the case of the discriminant function 
analysis six equations were worked out: (a) 


A. A. Rafi 


- Table 1 


Effects of Category and Sex: Analyses of Variance 


Mean squares 


Figure 
Marble Back- Tact 
Source df Board ground Mo! 
ee 

Category 3 131.950*** 428.245*** ua 
Sex 1 18.050% 103.512 Sg 
Interaction 3 7.017 48.213 0587 
Error 72 4.580 51.820 10. 
Total 79 


* Significant at .05 level. 
** Significant at .01 level. 
Significant at .001 level. 


bright versus dull; (b) bright versus mentai 
defective; (c) bright versus brain-damag” 1 
(d) dull versus mental defective; 
versus brain-damaged; and (f) men ati- 
fective versus brain-damaged. These conin 
sons are set out in Table 2. The first CO fe 
lists the comparisons as just enumera o 
The second column gives the equa uoni ack- 
X = Marble-Board score, Y = Figure- >% re. 
ground score, and Z = Tactual-Motor zA 
The third column gives typical D for Ai 
the first member of a given comparison, the 
the fourth column typical D for (B); sta- 
second member of that comparison. ‘The da 
tistical significance of results is indicate ffec- 
usual. In order to display the actual (2 
tiveness of discrimination the cumulative ; 
centages cut off by different values of D aly 
shown in Table 3 for the four statistics” 
significant comparisons and for the last CO 
parison because of its special interest. 


per 


Table 2 


Comparison of Categories: Discriminant Function Analysis 


Comparison D= 
a 0.90 X + 0.11 Y — 0.07 Z 
b 0.83 X — 0.06 Y +1287 
2 1.20 X — 0.01 Y +0157 
4 1.20 X — 0.17 ¥ — 0.03 Z 
TKE 1.04 X + 0.11 Y — 0.13 Z 
f —0.15 X + 0.25 Y + 0.06 2 


ificant at .01 level. 
e Significant at .001 level. 


Typical D z 
ena a F ratio 
for (4) for (B) (df =3 by 36) 
9.00 7.36 2.28 
13.40 6.22 30.86*** 
10.04 2.93 29.38*** 
4.10 0.65 5.39** 
7.93 3.20 10.64*** 
4.43 2.72 2.46 


- oe 
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Table 3 


Original Comparisons: Cumulative Percentages Cut Off 


Comparison 

Value b c d e y 
pin B*  MDt B BDt D§ MD D BD MD BD 
17 to 18 
Sto 16 o 
ii ee 60 100 100 

Oe a 45 95 90 100 

aa 30 80 55 100 e De 

5 15 65 235 95 5 

n° Do s 15 85 75 2 95 100 100 
me 4 45 65 50 100 15 60 40 75 
Sit, 2 30 50 30 90 40 15 60 
=a 5 30 10) 125 20 20 
sS 5 10 io 25 

ng 5 40 

* Bright sam 

le. 

i Bental defective sample. 

Dull samnceed sample. 
: original sample has as its analogue in the 


or’ the idation the 2 
ie tests i Ye pnma BERE second sample a case of tumor in the corpus 
Partly drawn fr p di t hospitals) of 20 callosum. As before, the test results were 
atients for tae a Pe: chosen so as to scored by the writer and independently by 
itespond to th ca PA ES in respect another person who was provided only with 
© age, sex ai hes 9) r vocabulary level. the actual results and sonne instantia 
pee only dive echsle! ological cla ssifi- disagreement once again we Baht he 
ation was ate ce eal injury in the cumulative percentages cut off by different 


Table 4 
s: Cumulative Percentages Cut of 


Cross-Validating Comparison: 
Comparison 
d x 7 

Value b c = : = -ag 
= B* MDt Bp BDI D$ 

ito a8 

Sto 100 

l3to 18 F ie 
Uto 12 70 os 30 af 

i 8 5 oy D 95 100 

to g 55 0 40 100 To Z o 33 ve 
Sto & 35 B it, a eet w a5 hi o 10 
Što 4 10 a 70 sis 6 ; 3 
“18 2 35 F a 75 A 5 90 
RA 0 25 0 
N 15 

N ri 


Bright 
sample. 
Mental defective sample. 
piain-damaged sample- 
sample. 
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values in the five relevant comparisons of the 
cross-validating samples are set out in Table 
4. It will be noted that the correspondence 
between the original and the cross-validating 
samples is close. 


Discussion 


The fact that mental defectives are signifi- 
cantly discriminated from the bright and dull 
patients indicates the dependence of success- 
ful performance in these tests on general in- 
tellectual efficiency. The significant discrimi- 
nation of the brain-damaged from the bright 
and dull patients without brain damage sug- 
gests that the Strauss-Lehtinen battery, if the 
Dot-Perseveration Test is dropped and a 
strict quantitative scoring system is employed 
for the other three tests, can be of assistance 
in this problem. The suggestion is strongly 
confirmed by the cumulative percentages data 
on the original and cross-validating samples. 
It is disappointing that there is no significant 
discrimination between mentally defective and 
brain-damaged patients, since no test has yet 
been devised which effectively answers this 
problem, and the statements of Strauss and 
Lehtinen (1) about endogenous and exoge- 
nous mental defectives have raised hopes that 
their battery might provide a solution. How- 


A. A. Rafi 


ever, consideration of the cumulative percent- 
ages data on this comparison in Tables 3 an 
4 indicates that at certain values of D (eS. 
1 to 2) a quite effective discrimination exists, 
which systematic item analysis might 1m- 
prove. 


Summary 


The Strauss-Lehtinen Battery for eae 
injured children was applied to 80 4 A 
mental hospital patients. The Marble-Bor i 
Figure-Background, and Tactual-Motor te 


Renin to 
were found, when quanitatively scored, | 
give jointly a successful discriminator E 


tween brain-damaged patients and brigh dis- 
dull patients without brain damage. The en 
crimination between brain-damaged and m te 
tally defective patients was much less matic 
factory, but it is suggested that apne: 
item analysis might improve it. The Le fi 
were confirmed on cross-validating samp! 

80 closely similar patients. 
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Normative Data on Progressive Matrices (1947)' 


Meredith W. Green and Josephine C. Ewert 


Mayo Clinic, Rochester, Minnesota 


ae 
36 ate ogressive Matrices (3) consist of 
Teasonin ay colored problems in perceptual 
Rien: hat, according to their author, can 
orm ei in either booklet form or as @ 
Problems a At the beginning of the series the 
come are easy to solve; they gradually 
tricate more complex, providing more 1m- 
nation p atterns and requiring more discrimi- 

in making the correct choice. 


_ Acco . 
Bye rate to the author, J. C. Raven, the Progres- 
Pal in fare while not a test of general intelligence, 
Md to Sa a person’s ability to form comparisons 
chat Sena by analogy, as well as to show to 
> taptions i he is capable of organizing spatial per- 
ass onl; nto systematically related wholes. The test 
pent te about 20 minutes, thus affording an et- 
dite ict gaining some information in those 
t coo uations in which a handicap of either 
Tdination or of verbal ability is present. 


] are based 


Wee T obtained by 608 children be- 
Comm, © 28es of 5 and 114 years in a rura 
ne pe of a non-American culture. In our 
festin this test as part of the psychologic 
Soon $ Of children at the Mayo Clinic, it 
Peareq came evident that these norms ap- 
Ly, to be too low.? Therefore, We decided 
sieno ye i j on- 
ae Se aet 
soo, F "of st. Francis Gat 
Schaefer Ochester, Minnesota, Superintendent oe 
ndeng ` of Stewartville, Minnesota, and Supe 
i Permitiio: Gustafson, of 
hols, URS this study to b 


Th 
e . 
a the norms in Raven’s manua 


wait a letter to the authors, Rave" explained er 
Carefyyy Sample of Dumfries school children, Wit 
its WY compiled, and there is no reason port 
evi, e curacy, be has the impression from repeater. 
these ce collected by others that e intelligence i 
, than gpumfties children is, on the average, lower 
He all ‘at for most of the urban districts of Belen 
Beneran Pointed out that there has been for severa 
f the population 


i 
Ons a steady movement 0 


to carry out a normative study on children 
in our area to determine the expected score 
for various age levels and the relationship 
existing between the Progressive Matrices and 
the standard group intelligence tests used in 
the public schools in our region. 


Method of Collecting Data 


To facilitate the collection of a large num- 
ber of test results quickly, the pages of the 
test booklet were reproduced on individual 
color slides, which permitted administration 
to an entire classroom at a time. 

This method of administration of the 
matrices by slides obviously raised the ques- 
tion of the relationship between results of 
our group tests and results that would have 
occurred if the test had been given to these 
children individually. Data were obtained 
from children between the ages of 6-6 and 
9-5; the 30 with the lowest scores on the 
slide form of the test were retested individu- 
ally and 45 students were given the individual 
form prior to the group tests. The results of 
these variations in testing methods indicate 
a consistent tendency for the children to show 
a significant gain when retested, apparently 
as a result of practice. Since the gains were 
similar for each group administration (ap- 
proximately 4 points), it was considered that, 
for the purpose of amassing normative data, 
the two methods of testing give comparable 
results. This agrees with Raven, who stated 
in his manual that there is apparently no 
real difference in test scores obtained from 
the booklet or form-board method of his test. 

r correlations were between 


The rank-orde 
62 and .87 for these distributions, which are 


m the rural districts into the cities or 


away fro 
abroad. 


139 


140 


sharply curtailed by age in both cases and 
by the narrow range of scores for those who 
had group tests prior to individually admin- 
istered tests. This indicates that students tend 
to maintain their relative position within the 
group despite the effect of practice. 

Our classroom testing included all the 
children in the second through sixth grades of 
four different elementary schools in the area 
of Rochester, Minnesota. The first two were 
parochial schools located in Rochester; they 
are estimated to have over 80 per cent of the 
local Catholic children. The third school was 
a consolidated one, located in a town of ap- 
proximately 1,100 population; the fourth 
school included three-fifths of the children in 
a town of 10,000. 


Results 


The slide administration yielded scores for 
1,214 children between the ages of 6-0 and 
12-5 years. A comparison indicated no sig- 
nificant difference in scores for the children 
in any particular school. The product-moment 
correlation between age and score on the 
Progressive Matrices was .55 (or, .02), in- 
dicating that in this group of children a posi- 
tive and moderately high relationship existed 
between age and success on this test. 

Table 1 shows by six-month intervals the 
number of children tested, the range of scores 
on Progressive Matrices, the mean score, the 
standard deviation, and the median. Also the 
Dumfries median score is quoted from Rav- 
en’s manual. It is obvious that the median 
scores obtained on the 1,214 children from 
the Rochester area are consistently higher 
than those given for the Dumfries school 
children. 

While Table 1 indicates that the median 
scores for children from the Rochester area 
show a steady increase that parallels increas- 
ing age, it is also evident that progression of 
scores is somewhat erratic. This irregular in- 
crease in median scores, together with the 
small amount of variation in median scores 
at times, seriously curtails confidence in the 
interpretation of individual scores at a definite 
age level. Both of these criticisms of the test, 
namely the need for more items so that 
chance errors would not distort the results 
and the ceiling effect at older ages, have been 
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Table 1 


Scores for 1,214 Children on Progressive 
Matrices (1947) 


Num- 
Age ber of 
(year/ chil- Mean Me- 
month) dren score 
6/0-6/5 27 18.6 
6/6-6/11 48 17.8 
7/0-7/5 93 20.2 5. 2 
V/6-7/11 101 210 63 434 21 4, 
8/0-8/5 110 235 5.9 7-34 24 fy 
8/6-8/11 116 244 53 836 25 7 
9/0-9/5 110 25.7 5.0 13-35 26 34 
9/6-9/11 118 25.7 57 9-35 27 
10/0-10/5 132 27.7 5.2 9-36 28 46 
10/6-10/11 100 28.6 4.5 15-36 29 3g 
11/0-11/5 107 29.0 43 15-35 30 
11/6-11/11 99 29.7 4.7 10-35 31 
12/0-12/5 53 291 52 1435 31 


* Median for children at Dumfries, Scotland. 

zed 
work 
noted by other authors who have 
with the matrices. 


Our interest then shifted to what ee 
ship existed between scores on Prog tel- 


Matrices and the results of standard rele F 
ligence tests. As would be expected, 


mun |] u 
wealys 
=| w 
Prete 
NEN 
Bus 8 
e 
waj & 
Roan| 
5 
a 
aod 
a BRE 
Raaa\egs 
BOF me 
~ pun Ss 
T o aM E: 


elatio” 
sive 


+o Mat 
tionship between scores on Progressive nis 
P t 


rices and Otis mental ages was nel tbe 
correlation was .78 for 192 children, ee 
students in one school between the a8 1, 
6-6 and 12-5. Table 2 presents the orice 
tion found between scores on the ma For 
and various intelligence tests (1, 2, F ween 
various age levels, the correlations be HOE 
IQ and scores on Progressive Matrices Be cor- 
from .19 to .69, but the concentration © 
relation coefficients was somewhere near ‘the 
The frequency of success on each of was 
36 items of the Progressive Matrices bs 
computed; data from all children 7-6 to 1 a) 
years of age in the largest school were US 
In Table 3 are recorded performances Eara d 
12 most difficult items, the ones that elici 3 
the smallest number of correct respons 
The increase in the proportion of childre 
responding correctly with increasing age Wee 
to be expected in view of the moderately 
high correlation (.55) already noted betwee” 
age and scores on Progressive Matrices. The 
fact that these same 12 items were the most 
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Table 2 
é Relationships Between Scores on Progressive Matrices (1947) and Results of Otis, 
California Mental-Maturity, and Kuhlmann-Anderson Tests 
Age (year/month) 
_ Statistic 6/6-7/5 7/6-8/5 8/6-9/5 9/6-10/5 10/6-11/5 11/6-12/5 
Number of children 2 31 51 49 47 36 
orrelation with Otis 1Q 
Scores 62** .69** .171** .38** .19* 35* 
Fogtessive Matrices, 
oma and SD 19.44 5.2 20.04 58 253+ 58 271+ 54 29.04 3.6 30.64 5.2 
Ma IQ, mean‘and SD 113.2 9.9 1104+ 7.0 114.2410.5 11014108 109.34 9.0 107.04 8.5 
meee of children 32 54 49 50 57 26 
relation with Californi 
paMental-Maturity 19 42** aye .42** r li 43** 45** 
gressive Matri ee 
cien and SD 227458 243465 259453 259+ 60 WSL 44 3004 3.6 
‘lifornia Mental-Maturity 
Nae mean and SD 126.34123 11664131 115.6415.0 114.74142 113.8415.0 108.7134 
oret of children i 6t 72 83 59 61 
—~Trelation wi 
nderson TQ. Sublmann- 8** 56** Ag** 52** 37%" 
Togressiy, ŝ 
isn 227458 247451 28.2451 WSt 50 2904 5.6 


Kee and SD 


Imann-Anderson IQ, 


mean and SD 107.44 8.9 101.5 7.3 102010.1 103.5+10.1 106.0+12.3 


+ Signifi 
"Significant at 0 level 
ditn these items with increasing age 
Cult thr f the responses to ; 
i ou e range 0 Z 
c, ildren ont Be e Ka was 4 for the consistency of the items. 


Sener, 
al ; in correct ; 
Feniency for an increase ™ Summary and Conclusions 


argue 


The Progressive Matrices (1947), devised 
py J. C. Raven, were administered by means 
of slides to 1,214 children between the ages 

f 6-0 and 12-5 years in four elementary 
schools in Rochester, Minnesota, and nearby 
areas. Preliminary investigation indicated some 
effect from practice on repetition of the test 


Per Table 3 l 
centage of Correct Answers on 12 Most Difficult 
Ttems of Progressive Matrices (1947) 
at Various Ages 


Age (year/month) 


11/6- 


7/6-  8/6- —9/6- 10/6 sonificant difference between scores 
2/5 t no Si 5 Sr Rate 

Stem oe 9/50 Ose eet ree) Pee aed by the slide form of administration 

AR Sue 5) Ce 30 and those obtained by the booklet form of 
1 go 12 27 H 60 he test. 

A = A s E 65 : The median scores for the children of the 

in 48 a 63 72 p Rochester area were consistently higher than 

BG 8 19 24 33 68 the median scores reported by Raven in the 

> 33 40 65 ee 65 manual, with a range of differences from 2 to 

s a os 44 63 6 points. Although the difference between the 

i 17 29 53 73 M Rochester area median scores at adjacent age 

u SUR 63 s 7 Jevels was frequently merely a point or so, the 

12 2 SL 2 2 37 over-all correlation between scores on mat- 

f $ F rices ‘and age was moderately high (correla- 


*N 
“number of children included. 
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tion of .55); a fairly substantial correlation 
was noted between the Otis mental ages and 
the scores on Progressive Matrices (correla- 
tion of .78). However, correlation with IQ’s 
obtained from three different standard group 
intelligence tests used in these schools was 
only moderate (average correlation slightly 
greater than .40). Scores on Progressive Mat- 
rices correlated with the more verbal intel- 
ligence tests to about the same degree that 
they did with those tests which stress non- 
verbal aspects. Therefore, it would appear 
that the Progressive Matrices cannot be 
thought of as a test of nonverbal reasoning 
ability but instead should be considered as a 


test of fairly complex intellectual reasoning 
processes. 


Meredith W. Green and Josephine C. Ewert 


The frequency with which the items were | 


answered correctly by a portion of the total 
group indicated that the items tend to mam- 
tain a stable order of difficulty; also, there 
was a gradual decrease in failure on items 
over the age range from 6-0 to 12-5 years. 
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Relationships Between Verbal and Nonverbal Parts 
of the CTMM and WISC 


Grace T. Altus 


Santa Barbara County Schools 


ee f the reasons for the increasing pref- 
inet s the WISC (3) over the Stanford- 
Verbal undoubtedly its separation into 
choice ko Performance scales. Similarly, 
turity the California Test of Mental Ma- 
of e CTMM (2), as a group measure 
Yields re is frequently made because it 
IVs, T} och Language and Non-Language 
y Schoot tacit assumption is often made, as 
the ee Psychologists using both tests, that 
tions st onding verbal and nonverbal por- 
Some q the two tests are highly correlated. 
Validit ata are here presented bearing on the 
i Of this assumption. ; 
childre Subjects were 100 elementary schoo 
Guida N, 71 boys and 29 girls, referred to the 
Coun ce Department of the Santa Barbara 


of means on corresponding parts of the two 
tests is noticeable. 

Although the wide sigmas for both tests 
would tend to raise intercorrelations: spuri- 
ously, there were other factors operating to 
reduce such 7’s: the fact that the group tests 
were given and scored by teachers in an in- 
formal school setting rather than under pre- 
cise experimental conditions, the time inter- 
vening between tests, the inclusion of children 
with serious reading problems who would be 
handicapped on the group test, and the like. 

Nearly half the children (W = 49) had 
mixed language backgrounds, primarily Span- 
ish-English. Somewhat surprisingly, the ma- 
jority of this bilingual sample did better on 
the group test than on the individual one on 
both verbal and nonverbal sections, with the 


ou 
t Sch : . The modal eci 
reas os = by their separa? eration for trend reversed for the unilingual sample. 
ie cena et ey ra Ce ec r een ai cote 
oe er e mentally e referred for & however, the bilingual group did conspicu- 
i Y of Stine: eee gate placement, ously horer E we nonverbal portions than 
‘Adams ons includi ortions: 
ang wie disabilities, emotional disturbances, 0” the: verbal porHons 
Wyg ie like. All children were given the Tapet 
Show „PY the writer and the Elementary ast 
ol Ske Form MM in their regular Means and Standard Deviations of WISC and 
Ta rooms Ta = F routine county test- CTMM Intelligence Quotients 
s part of a É 
Wigi sram, In the cases of 66 children the Test Mean S 
RS and CTMM were given less than 4 D 
Muc apart, while in no case Were the tests 85 wysc 
as three years apart. Verbal 82.7 17.2 
Table ld ye p composition of the Performance 89.8 16.3 
Stroup „1 describes the CO! ’% on the Full Scale 84.5 17.4 
two © With respect to obtain Rie oe 
Pec tests. Tt can be seen—as might be = CTMM 
We ted from the method by which subjec Language 81.8 17.3 
era Stlected—that the sample is 0” the a T se 20.0 
R less intelligent but also more cos ones a 17.4 
Tan unselected population. The simta 
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Table 2 


Intercorrelations of WISC and CTMM 
Intelligence Quotients 


Grace T. Altus 


: it 
havioral correlates or aptitudes, but surely 
is a difference. mate 

Further analysis of test scores was 


«ae dual 
by tabulating IQ differences for indie 


I MM children on the three pairs of correspon 

= = 1Q’s—verbal, nonverbal, and total ot 
Non- WISC and CTMM. The nonverbal ; 
Test Perf. Full Lang. Lang. Total showed the greatest number of wide dischi 
WISC ancies, with one child in four showing $ sen 
Verbal -47 93 -71 65 T6 ference in excess of 18 IQ points be Be 
Performance K 37 67 -68  WISC Performance and CTMM Be. 10's 
peo Pack a guage IQ. The difference between es ai 
CTMM on the two tests was, however, less eating 
Tanguage -57 89 IQ points in 65% of the cases, iN Jiction 
Ae ai 85 reasonably adequate individual pre 
from one test to another. d to con 


Thus, 76% of the bilingual group had 
higher IQ’s on the CTMM Non-Language 
than Language test, with 27% of the group 
exceeding an IQ discrepancy of 20 points in 
this expected direction. These findings would 


appear to conform to what one might theo-' 


retically expect for the test pattern of a bi- 
lingual—and in this case also economically 
underprivileged—group: that is, evidence of 
greater ability on tests not requiring verbali- 
zation. Similar findings for the WISC were 
reported by the author elsewhere (1). 

Table 2 shows the interrelationships de- 
rived from Pearsonian correlations of the in- 
dividual and group tests and their subpor- 
tions for the entire sample of 100 children. 
Whereas the corresponding verbal portions of 
the two tests are substantially correlated, 
and the corresponding nonverbal portions 

- only slightly less so, it would appear that the 
CTMM Non-Language has considerably less 
overlap with its partner scale, the CTMM 
Language, than the WISC Performance has 
with the WISC Verbal. The analyses of the 
two tests, then, cannot be considered fully 
parallel. In the absence of external valida- 
tion of the two nonverbal tests, one cannot 
be sure what the difference represents in be- 


In short, it would seem justifie Hee 
clude that, within a comparable s¢ M are 
ferral setting, the WISC and CT asst 
markedly comparable as to group 455 dividu 
and roughly comparable as to 1 
scores and major breakdown into ie entia- 
nonverbal abilities. The precise di hi 
tion of the latter abilities deserv de- 
exploration, could studies be devise rbal 25 
termine the actual moaning oF ie: j- 
opposed to verbal tests. e tive 
lingual children did better on the pea 
nonverbal tests than on the verbal ad Jn 
to be evidence of their intrinsic vale ip 
any event, the saturation of verbal oe 1d 
virtually all the tests herein discusse sing. 
imply their usefulness in a school set 
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Food Aversions: Some Additional Personality 
Correlates 


Wendell I. Smith, Elizabeth K. Powell 


Bucknell University 


and Sherman Ross 
University of Maryland 


(0) 
havion a the interesting aspects of human be- iety, and if the fear and anxiety can be as- 
Seon at has been relatively unexplored is sumed to displace to several areas of behav- 
a of food habits. There are many facets ior, then we can predict that (a) Ss having 
an ae which need to be undertaken to @ large number of food aversions will have 
a e variables that enter into this com- marked neurotic characteristics, and (b) such 
Tea sy uiversal behavior (8). Foods are 4 Ss will tend to report that they dislike and 
Vito Y available portion of the behavioral en- will not eat foods which they have never 
Ment at which responses can be directed. tasted. The second prediction could represent 
a socially acceptable way of expressing Ss’ 


Series 
Sio, Of studies whi ith food aver- c J 
u k as been ee T of these (3, fear and anxiety.’ More simp ly, those SE TRO 
aha R have heen r oola have many aversions for foods which they 
ang eet —— renee Se they “dislike have tasted will generalize this aversion to 
Would not ep : Pe ee se controls. foods which they have never tasted. 
e : 
bety ey reported on the relation Rn Method 
et Core, ifest AnI- 5 ss 
ae Scale eta Taylor Me oeie ig check list of 28 selected foods (see 
ood aversions pancreas ut Table 2) was given to 235 undergraduate 
ale and 118 female) in in- 


between students (117 m 
nd troductory psychology classes. The following 


aya S On foo! : 
Vergi, 2 the A scale and the B, of have instructions accompanied the check list: 
the Hesniertinees aE high scores Indicate which of the foods in the list below you 

` The 4 scale wh used with neurotic Ss: refuse to eat. Do this as follows: Read over the 
| Qua ; nd that en use cond an ir list slowly. When you come to the name of a food 
tiles scores in the se ticism you dislike, put a circle around the number of that 
were more predictive f neuro food. After marking all the foods you do not like, 


Sı is 7 Py s, 
May Cores in the top quartile. These ies go back over the list and draw a circle around the 
f relations iP hames of all the foods which you dislike, but have 


d. After each food you dislike, state the 


wae x 
Which *plain the low degree ° 
A e found never taste! T € 
tin © pre ee from our con- reason for your dislike. 
ueg Ptesent study stems i Laeti X 
Parts of three paper-and-pencil inventories 


f S : j e 
Qoq „ terest in the relations? teristics a 
which purport to evaluate characteristics 


We aversion i 
s and personality ©." i, be- 
ho R ionship which we believed might be related to the 


c 
Pe to determine the relat an 
lity factors ber of food i ini 
nal number of food aversions were also adminis- 


n 
I Bero, Some additional perso ree 
nce on a check list © EA E To 
late * large number of f00 a on ine 
% i e 
Sha, tie „neurotic trends, ©. fear and anx- 
eristic of the neurotic 1S 145 


1 We are indebted to Dr. J. W. Gustad, University 
of Maryland, for assisting us in developing this ap- 


proach. 
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tered to this group. The inventories used 
were: P-S Experience Blank, Part 1 Physio- 
logical (5); The Personal Audit, Form LL, 
Part V (Stability-Instability) and Part VII 
(Emotionality-Steadiness) (1); and the F 
scale of authoritarianism (2). Additional in- 
formation concerning Ss’ sex and age, father’s 
occupation, religious preference, frequency of 
attending church, etc., was requested. Names 
or other identification was not required. 


Results and Discussion 


Two food aversion scores were computed 
for each S. The first (FA-I) was the total 
number of foods which S checked as disliked. 
The second score (FA-II) was FA-I minus 
the number of foods checked as disliked but 
which S had never tasted. FA-II then is the 
number of foods which S has tasted and for 
which he has an aversion. The results ob- 
tained from this procedure should be fairly 
close if Ss have very few aversions for foods 
which they have never tasted. The relative 
magnitude of the difference between FA-I and 
FA-II should provide information on whether 
or not familiarity with a food is an impor- 
tant determinant of the number of food 
aversions (3), 

From the total sample of Ss we drew two 
samples: High FA and Low FA. The cutoff 
for the High group was 6 or more checked 
items, while the cutoff for the Low group was 


1 or O items. Two such groups were made for 
each of the FA scores as follows: 
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mean score for each of the groups on each 
inventory was computed and tests of the ae 
nificance of the difference between the Hig 
and Low FA groups on each test were made. 
These results are presented in Table 1. d 
It is clear from Table 1 that the High as 
Low groups differed significantly on all ba 
the F scale. In all cases, the mean scores z 
the High FA groups tended more we 
those obtained for neurotic populations t 
did the mean scores for the Low FA go 
Interestingly enough, the results on te 
thoritarian scale for both the High and 2 
FA groups were nonsignificant even thos 
the description of the authoritarian pers 
ality would lead one to expect that the 
scale might differentiate between those nf 
who are characterized by relatively high am 
iety, relatively poor emotional conto i 
stability, feelings of inadequacy, and eae 
logical dysfunction, and those who are pas 
mal in these characteristics. Masling oe 
made this point previously. That the F od 
scores of very extreme groups (extrem ver- 
that they reported not more than two afer 
sions or nine or more aversions) may -hich 
significantly is indicated by the results r 
we obtained from a comparison of a Ss 
highest- and 15 lowest-scoring Ss. ‘ pos 
were all females, A similar analysis f% ; 
extreme male Ss did not result in 4 | 
cant difference for F-scale scores. 


are 
to the evidence to be presented that there 


food 
i (a) FA-I marked sex differences in the number 0 
Pien Sann Mean = 7.2 + 1.4) and FA-I aversions. the 
E oii = 0.6 = .5); (5) FA-II In our earlier study we proposed that ight 
S E 1, a? = 9.82.3) and FA- data obtained from a check list of foods ™ a 
= 40, Mean=0.6~.5). The be more meaningful if information on eP 
Table 1 
Personality Test Results for High and Low FA Groups 
Ar FA-II 
High - Tow High Tae 
aoe = Se Mean SD Mean SD Mean SD 
Emotionality 56.6* 11.9 33.3 11 12.2 
Stability 41.2* 224 310187 a. 1.7 ae os 
P-S inventory 119.7* 42.3 90.2 45.0 BE gue sae 51.9 
F scale =19 21.5 5.7 22.4 Be Ais ee 23.9 


* Difference between High and Low groups significant at the .01 level of confidence. 


T 


Food Aversions: Some Additional Personality Correlates 


Toe each food and the reasons for dis- 
aa i each food were available. We made an 
(a) ora this study to collect these data by 
fetes tate each S signify which foods he had 
Teason paar ype (b) having each S state the 
rom or his aversion to each food checked. 
food our analysis, it appears that the two 
N 6 in orm have approximately the 
aoe iscriminative power. Low and High 
a whether selected by FA-I scores or by 
ree scores were significantly different on 
eriy the four inventories. This finding was 
gard 4 from analysis of the data without re- 
anal 9 sex. As we will now show, when the 
Wo se S made taking sex into account, the 
nifi goa aversion scores for females are sig- 
cantly different. 
(Ny OmMparisons were made between male 
each 117) and female (W = 118) Ss on 
ae the inventories as well as on food 
ilit Ììons, Only on the trait of stability-insta- 
signif was the difference between the sexes 
Some cant. The female Ss as a group were 
rehat less stable (CR = 3.78). As in 
fo vious studies, female Ss reported more 
the » Versions than did male Ss. For FA-I, 
and Mean for male Ss was 3.1 + 1.7 aversions 
For hn female Ss it was 5.3 + 2.9 aversions. 
Ver PA-II the mean for male Ss was 2.6 + 2.7 
Be ae and for female Ss 4.3 = 2.6 in 8 
a (CR = 2.22). On both scores female Ss 
the” Significantly higher than males. rub 
bighe -I mean for females is significant y 
While. (CR = 2.89) than the FA-II Be 
Chee or Males there is no significant fine 
for between the mean FA scores. Seeming 4 
y e sample of females there was 2 E 
tasted”, dislike foods which had neve 
R indicating generalization. k 
by ‘Urther check for this factor was m 


sion, P aring those Ss who reported, ah 
thos, to foods they had never taste PE 
tarp SS who reported that they had à 3 
ver, Of the foods for which they es 
Pig, on. This was done for female Ss more 
Ave Y-six of the females reported one or pre 
PA. Sions to foods never tasted. The m ”) 
Was Score for this group Gamer 
fto 651.7. A group of 25 Ss was EO 
the the remainder of the female on af 
thy. Sis of their FA-I scores. Be PAD 


8roup (“nongeneralizers”) was 
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Table 2 


Percentages of Male and Female Ss (N = 235) 
Reporting Food Aversions for 


Each Food Item 

Food Male Female 
Mushrooms 16 26 
Cottage cheese 22 19 
Swiss cheese 11 17 
Tea 6 21** 
Bean soup 6 21** 
Salmon 9 13 
Lima beans lit 14 
Radishes 6 11 
Cabbage 8 14 
Cantaloupe 3 4 
Potato soup 9 16 
Grapefruit juice 3 9* 
Veal chops p 2 
Fried eggs 3 14** 
Tomatoes 0 3* 
Cherries 0 6** 
Pears 0 3* 
Salt pork 9 11 
Liver 21 37** 
Kidneys 18 25 
Brains 14 14 
Gravy 0 3* 
Chili 4 15** 
Chocolate 1 1 
Beer 12 32** 
Buttermilk 45 49 
Onions 8 13 
Mush 13 19 


* Sex difference significant at the .05 level of confidence. 
# Sex difference significant at the ‘01 level of confidence. 


Thus, the total number of aversions was held 
constant and a chi-square test was made to 
determine whether or not the two groups dif- 
fered in their means for each of the person- 
ality measures. A chi square of 9.575 (3 df, 

< .02) was obtained. The groups differed 
significantly only on the F scale, on which 
the nongeneralizers were found to be much 
less democratic than the generalizers. When 
the generalizers are compared with the full 
sample of female Ss, the mean FA-I score 
and all inventory scores are practically identi- 
cal. These results indicate that, although more 
female Ss than male Ss report aversions for 
foods which have never been tasted, the fe- 
male Ss so reporting do not differ in test per- 
formance from the total female sample. No 
ready explanation occurs to us for the lower 
F-scale score of those Ss who did not report 


aversions to foods never tasted. 
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In Table 2 the sex differences in aversions 
for each of the 28 foods are presented. Sig- 
nificantly more female Ss than male Ss dis- 
liked 11 of the foods. When we compare the 
present findings with those obtained in our 
previous study, the differences between the 
sexes overlap on only two foods, chili and 
beer, indicating that the two samples differed 
in the frequency with which each food was 
disliked. 

In order to clarify the differences between 
the extremes of our sample, the 15 Ss having 
the highest FA-II scores and the 15 Ss hav- 
ing the lowest FA-II scores were selected for 
comparison. Since the High Ss were all fe- 
males, only females were selected for the Low 
group. The Low group mean was 1.3 aver- 
sions, while the High group mean was 10.8 
aversions. The mean inventory scores for the 

Low group were well within the range for 
“normals” while the scores of the High group 
bordered on those typical for neurotics. All 
the differences between the two groups were 
Statistically significant as determined by chi- 
Square tests comparing obtained scores on 
each inventory with expected scores on each 
inventory. The chi-square values (with 1 df) 
obtained from comparing these Low-and High 
female groups on each test were: P-S Experi- 
ence Blank, 80.5 (p < .001); Stability-Insta- 
bility, 15.6 (p< 001); Emotionality-Steadi- 
ness, 14.7 (p < 001); and F scale, 4.12 (p 
< .05). 
` Examination of the biographical data for 
these 30 Ss did not reveal any apparent dif- 
ferences between the groups in age, parents’ 
education, religious preference, father’s occu- 
pation, size of home community, and regu- 
larity of attending church. There were two 
and one-half times as many only children in 
the High group but the sample is obviously 


too small to attach great significance to this 
factor. 


When Ss’ reasons for their aversions are cones 
ered, one is struck with the superficiality of the 
answers. After examining the responses, we decided 
against any formal categorization. Slightly less aa 
half of all answers consisted of “I don’t like the 
taste.” This response leaves us little more informa- 
tion than we had when we started. A comparison 
of the reasons stated by the Low group and by the 
High group on FA-II scores provides only one in- 
teresting point. Forty per cent of the reasons given 


Wendell I. Smith, Elizabeth K. Powell, and Sherman Ross 


by the High group could be categorized as respon 
which would probably not usually characterize d 
food. For example, such adjectives as “mushy pe 
“slimy” were applied to foods such as liver, ‘one 
toes, beans, and chili. Such descriptions as ee a a 
me indigestion,” “I don’t like the feel of it,” an a 
can’t even stand the thought of it” were con 
These statements were applied to such come z 
consumed items as beans, tomatoes, liver, ee E 
cherries, eggs, onions, and beer. This point 1s oar 
terest, since only one response in the Low & sA 
could be so categorized. This single response ic to 
given to fried eggs. The S wrote: “I am ale our 
concentrates of protein.” It is unfortunate thak a 
Ss were anonymous, since it might have been 

able to interview them intensively concerning 
reasons for their aversions. 


The results of this study give indirect s 
port to the hypothesis that there is some ate 
eralization of affect to the socially acres 
area of food habits. There is a tendency et 
individuals who report disturbances ad of 
tive behavior to report an unusual num 
food aversions. 

Lewin’s (4) contention that “peo they 
what they eat, rather than eat what The 
like” seems to be an insightful inference: ith 
Ss in our study did not like those coe rity 
which they had had no experience. Fam} stoi 
of the food appears to be an important fa sti 

The bases for the aversions reported in 
remain to be clarified. Intensive interv at 
might result in fresh leads to this Py ture 
An interesting lead to be explored in Sale 
studies is supplied in Margaret Mead’s $ by: 
ment that food habits may be influenced 3 
“The Puritan tradition of a connection nd- 
tween food which is disliked, and the te ion 
ency in communities with a Puritan tra disan 
to use food for purposes of reward and pu 
ishment . . .” (7, p. 23). 


ple like 


Summary 


This study deals with the relationships Pa a 
tween food aversions (FA) and personalit 
characteristics. A group of 235 undergradua y 
students was studied for possible relation” 
ships between FA and scores made on fou 
selected personality inventories. These inven 
tories were: (a) P-S Experience Blank, (2 

The Personal Audit (Stability-Instability) 
(c) The Personal Audit (Emotionality-Steadi 
ness), and (4) F scale of authoritarianism- 
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a kinds of FA scores were computed and 
ee A categorize the sample in a variety of 
me r comparison purposes. The first score 
check Te on the total number of items 
e aa disliked from the list of 28 foods 
numb he second score was based on the 
which S of items checked as disliked but 
compari reported he had tasted. The basic 
B risons were made between selected High 
for Ow groups for each of these scores, and 
ain differences using the total sample. 

si he results permit the following conclu- 
lons; 

l. High and Low FA groups on each scor- 
E technique differed significantly on all of 
a sonality inventories, except for the F 
Scores The High groups were closer to the 
rea ned by neurotic Ss on these in- 

Ories, 

on Female Ss (N = 118) reported signifi- 
uy higher FA scores than male Ss (V = 
a significant differences were found De 
signif the two FA scores of the male sa 

two p 2t difference was found between the 
inter ‘A scores for female Ss. This result T 
enc: Preted to mean that there was a tend- 
h Y for female Ss to dislike foods which they 


never tasted. 

Were The stated reasons for an ra 
tion Most frequently in the form of des! i 

cha Which would probably not be the us 
‘acterization of the food. Li 
these limited interpretations Were ee: 
ndings in regard to the role 0 oe 

“cially acceptable objects against W 


in 
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the effects of anxiety and fear can be di- 
rected. 


Received July 6, 1954. 
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The Effect of Pinhole Observation on the Flicker 
Fusion Frequency in Patients with Brain Pathology 


James C. Stauffacher, John B. Marks 


VA Hospital, American Lake, Washington 


and Albert F. Ax 


University of Washington 


This study was designed to determine 
whether or not the lowered critical flicker 
fusion frequency (CFF) of patients with 
brain pathology is a result of alterations in 
the size of the pupil and whether use of a 
restricted pinhole pupil might not increase the 
effectiveness of CFF examinations in screen- 
ing patients with brain pathology. 

The experimental group consisted of 21 pa- 
tients with various organic brain disorders. 
The control group consisted of 21 psychotic 
patients with no known brain pathology. 
Each patient of the brain pathology group 
was matched in age with a control patient. 

The intermittent visual stimuli were ob- 
tained by using a Strobotac to activate a 
neon bulb which was painted black except 
for an orifice 36 inch in diameter, through 
which the glow plate was viewed. The bulb 
was mounted at one end of a lightproof box 
40 inches from the viewing cowl from a 
stereoscope. One eye could be shielded by 
the insertion of a plate, and a second plate 
with a pinhole of .046-inch diameter could 
also be inserted before the other eye. 

Each patient was tested for CFF under 
three conditions: with the usual binocular 
stimulation, monocular stimulation, and mo- 
nocular stimulation through the pinhole. The 


1An extended report of this stud: 
tained without charge from J. C. Stauffacher VA 
Hospital, American Lake, Wash., or for a fee Fea 
the American Documentation Institute. To obtain it 
from the latter source, order Document No, 4467 
from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.75 for micro- 
film or $2.50 for photocopies. Make checks payable 
to Chief Photoduplication Service, Library of Con- 
gress. 


y may be ob- 


order of these conditions was alternated Yr 
tematically and the establishment of & ne 
set” was avoided by systematic aier ai 
the beginning frequency of the light $ Biy 
lus. Fatigue was minimized by havmg aa 

jects close their eyes between observa Te 

The usual binocular condition discrim! 
between the brain pathology and when 
groups at the .01 level of confidence 
the mean of the up trials (28.05 and 
the mean of the down trials 
31.30), and the mean of the up an dered: 
trials (27.55 and 31.25) were con? ation! 
When compared with binocular ae hti 
the monocular condition produced S clogy 
smaller differences between the saris fas 
and control groups and the differey i í 
tween the groups reaches the .01 lev ine 
confidence for each criterion used. Whe? bi 
hole observation is used, the pathology & T 
has lower CFF in mean up trials (17.5 89); 
18.20), mean down trials (15.94 and ee 
and mean of up and down trials (16.75 1er 
18.04). However, the differences are s™4 ig- 
and the reliability is greatly reduced, the a 
nificance levels being .25, .01, and .05 
spectively. 

These results indicate that differences 
CFF between pathology and normal group 
cannot be explained in terms of variations F 
pupil size. The usual binocular observati? 
yielded a more reliable difference betwer 
Pathology and control groups than did 1 
Pinhole observation used. The factors 1° 
sponsible for the reduction in the reliability 


of pinhole observation are not indicated fro™ 
the study. 


in 
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Emotional Adjustment and Dieting Performance' 


John Summerskill and C. Douglas Darling 
Department of Clinical and Preventive Medicine, Cornell University 


a recurring observations on obesity sug- 
Orders pe lationship to psychosomatic dis- 
to 5 irst, body weight is directly related 
tak oric intake (3, 4, 5, 9). Secondly, caloric 
relat, oe in some degree and in some manner 
3 ed to the individual’s emotional state (1, 
of fe 7, 8, 10). Consequently, the treatment 
treat sity necessarily involves dieting, but 
am is successful only if emotional con- 
kea are favorable. This research was n 
Hiken the latter relationship: emotiona 
ote s on dieting performance. ; 
eri e immediate problem was posed in ex- 
iments conducted at Cornell University On 
W cacy of certain diets (11, 12). Subjects 
daily Siven three carefully measured mea 
effe Y for three months. Evaluation of dietary 
ects involved continuing weight checks, 


BN metabolism studies, fecal balance ene 
iš blood sample analyses, etc. The validity 
tio € findings from these intensive pea 
of NS was largely dependent upon the abi ity 
diet © subjects to adhere rigorously to | : 
Pros regime for a full three-month period. 
Se ee this standpoint it was japon 
fully, Subjects who were able to diet su 

The 


that there is a 
Posi ed 


aut hesiz a RT 
hors hypothe t to quantification, 


tive $ A j 

b relationship, subjec ee c- 
ces een emotional stability, and omen 
da Validation of a technique for Er EN 
“tary research subjects Was underta 


*Th t i 

o e diet experiments, conduc orted in 
E Nutrition, Cornell Universit: oa Smd in part 
by by. the Gannett Nut ee Fon f New York 
R a iation from the zish to 
enough R E The amon oore, 
Sss their appreciation A Charlotte M. Young, 
Ph D Jeffrey Fryer, Mp rition, 
» of the School of ychologic 


Tec, COOperation in the PS $ 
Search 


ed by the School 


the assumption that it would be relevant to 
the diagnosis and treatment of obese patients 
in clinical settings. Suitability for dieting is 
important in view of the recognized possi- 
bility that acute disturbance can be precipi- 
tated in maladjusted individuals when eating 
habits are radically altered (2). 


Method 


Psychological tests were administered to 
subjects of three dietary experiments con- 
ducted in the spring of 1952, 1953, and 1954. 
The total number of subjects tested was 29, 
including 17 college women and 12 college 
men with an average weight excess of 25%. 
Scores on emotional adjustment were subse- 
quently compared with: (a) pounds lost 
through dieting and (b) diet performance 
ratings. The second criterion was included in 
the design because pounds lost does not ade- 
quately represent dieting success as it relates 
to individual differences in percentage of 
overweight, activity expenditure, and other 
factors. Each dieter was rated on his demon- 
strated acceptability (+ or —) for controlled 
dieting by the physician, nutritionist, or 
dietician who had supervised the dieting. 
Two independent ratings were available for 
23 subjects and these were in agreement in all 
cases but one. Specific methods employed in 
each of the three experiments were as follows: 

Experiment I (1952). During the course of 
the first dietary experiment the nutritionist 
learned that not all subjects were adhering 
strictly to the diet provided. At the comple- 
tion of dieting, this situation was brought to 
the attention of the writers who then studied 
the six of ten subjects still on campus. Each 
subject was seen in an evaluative psychiatric 
interview and was administered a battery of 
psychological tests including: (@) Bell Ad- 
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justment Inventory, (b) Bernreuter Person- 
ality Inventory, (c) MMPI, and (d) Thur- 
stone Personality Schedule. 

Experiment II (1953). The results of Ex- 
periment I suggested that prediction of diet- 
ing performance was feasible from a single, 
objective index of emotional adjustment. 
There were also indications that adjustment 
during dieting was largely expressed through 
psychosomatic complaints. Accordingly, the 
11 subjects of the second dietary experiment 
were tested before dieting began with the: 
(a) Bell Adjustment Inventory and (b) 
Psychosomatic Inventory. These tests were 
repeated at the midway point and at con- 
clusion of the diet. 

Experiment III (1954). To cross-validate 
the selection procedure and increase N the 
two tests employed in Experiment II were 
administered to 26 applicants for the third 
dietary experiment. Twelve subjects were 
then selected for the diet, each above aver- 
age on test measures of emotional stability. 


Results 


A positive relationship between above av- 
erage emotional adjustment and dieting suc- 
cess was found within each experimental 
group and for the experimental groups com- 
bined. Table 1 shows the dieting perform- 
ance of subjects who demonstrated better 
than average vs. average or below average 
emotional adjustment according to the col- 


Diet Performance Ratings and Mean Weigh 
Below Average Bell 
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ently rated as acceptable dieters whereas ony 
18% of the other individuals were so rated. 
This relationship is highly significant Ge 
01) according to a chi-square test on a 
fourfold table (Yates’ correction for TEIA 
frequencies employed). With regard oF ; 
other criterion, well-adjusted individuals o 
an average of 21.0 lb. (SD = 5.25) ba. 
other individuals lost an average of 13.07 i 
(SD = 5.17). A é test shows that this diffe 
ence is highly significant (p > .01). ie 

Table 1 contains additional data g ie 
predictive value of the emotional scale 3 2 
Bell Adjustment Inventory. Dieters se a g 
for Experiments I and II without the ue i 
test scores proved to be acceptable in 7 a fo 
cases. On the other hand, dieters selecte a 
Experiment III on the basis of tesia 
proved acceptable in 9 of 12 cases. A 
three groups test scores accurately can 
dieters as acceptable or unacceptable 1 
of 29 cases. 


fied 


too 
Other observations, some based on ere 
small for statistical treatment, were as fotonai 29) 
1. Psychological adjustment scores from eement 
Inventory (23 cases) were in essential es s 
with Bell emotional scores and showed ee 
Positive relationship with dieting performan al sta- 
2. Psychiatric interview findings on emonori test 
bility (6 cases) were in essential agreement W! 
indices of emotional adjustment. the 
3. Indices of adjustment in other areas Seer) 
Bell home, health, and social adjustment si 2 
cases) were not related to dieting performance: a! 
4. Test scores before, during, and after dieras x- 
subjects) were essentially unchanged, with orek el 
ception. The number of somatic symptoms TeP 
was somewhat greater during dieting. 


t Loss of Dieters with Above Average and Average of 
Emotional Ad jusi 


tment Scores 


Dieters with above average 
Bell emotional 
adjustment scores 


Jow 
Dieters with average oF be 
average Bell emotion® 


adjustment scores 
iho ae EE 
n 
Experimental Number Mean Number Meni 
group N Fated pounds rated poun 
Areeptable lost N acceptable lost 
Experiment I (1952) 3 2 2 J44 
Experiment II (1953) 4 3 ine 4 1 133 
Experiment III (1954) 12 9 2119 7 it 
All groups 18 14 21.0 eo 


2 13.6 
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5. Analysis of Bell emotional adjustment items 
showed No consistent pattern of symptoms among 
maladjusted dieters (11 cases). Similarly, there was 
No single or unique personality pattern evident in 
the psychiatric interviews of three dieters of inferior 
emotional stability. 


Discussion 


Tis recognized that results are based on a 
Small sample of college students and that ex- 
tension of conclusions to a general population 
Will require further research. Confidence in 

© demonstrated relationship between tested 
anotional adjustment and dieting perform- 
ae im college students is strengthened by 

© Consistency of findings in three discrete 
e periments. With this in mind, the writers 
el that objective tests of emotional adjust- 
ment, e.g., the Bell or P-S Inventory, can be 
Profitably used in selecting individuals who 
can handle the pressures involved in con- 
trolleq dieting, a 
ne findings also support the authors’ clini- 
a observation that serious emotional disturb- 
nce may or may not be present with obesity. 
goo chiatric case studies of obese patients 
inuctimes leave the impression that obesity 
Xvariably reflects serious deep-seated ton: 
ame he present results indicate that cae 
5 M be associated with varying states 0 i 

Onal adjustment from the essentially ian 
nil to the seriously disturbed. When signs a 
pod emotional adjustment arè present, e 
t ances that dieting will be ee a 
Whe, bout four times as great as they 
Cn these signs are absent. 


Summary 
The Purpose of the research Was ge 
-Mine the relationship between ee to 
dey rent and dieting performance sndividuals 
su è a Procedure for selecting m istically 
Yitable for controlled dieting. A statist 
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significant relationship was found between 
objective test measures of emotional adjust- 
ment and (a) pounds lost through dieting 
and (b) independent diet performance rat- 
ings. The results show that psychological in- 
struments such as the Bell Adjustment In- 
ventory, or Psychosomatic Inventory, can 
be profitably used in eliminating individuals 
whose participation in rigorous dieting can 
have undesirable consequences. The findings 
also indicate that obesity can be associated 
with varying states of emotional adjustment 
from the essentially normal to the seriously 
disturbed. 
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Bauman, Mary K. (Ed.) Adjustment to blindness. 
Harrisburg, Pa.: Commonwealth of Pennsylvania, 
State Council for the Blind, 1954. Pp. xiii + 198. 


This intensive study of 443 blind persons from 
six states is a real contribution to the literature of 
adjustment to handicaps. The three groups studied 
were: (A) employed and generally well-adjusted 
(N = 162), (B) well-adjusted except in employment 
(N = 150), and (C) generally poorly adjusted, in- 
cluding employment (N=131). They were first 
found not to differ in sex, color, residence, birth- 
place, height, weight, or age. (Group B was made 
up of somewhat younger people.) With these fac- 
tors constant, differences appeared in favor of well- 
adjusted employed blind in intelligence and person- 
ality inventory scores. These factors overshadowed 
amount of visual loss, health, education, and family 
and social interaction as influential causes. It would 
have been more satisfying to the critic to have a 
clearer discussion of the use of the criteria in set- 
ting up and separating the three groups. Although 
most of the criteria were objectified and tabulated, 
their importance was minimized by reporting them 
along with the dependent variable. Since a person- 
ality inventory adapted to the blind was adminis- 
tered rather than a standard one, it would have 
been well to have included it, in addition to a de- 
scription of its parts and reliability coefficients. This 
report presents a prodigious amount of reliable in- 
formation on employment, recreation, home life, 
travel, and health which will greatly assist those in- 
terested in the rehabilitation of the blind. A help- 
ful 123-title bibliography concludes the volume— 
F. McK. 


Holsopple, James Quinter, & Miale, Florence R 
Sentence completion. Springfield, TIl.: Charles c 
Thomas, 1954. Pp. xiii + 177. $5.50, 


This little book has many charms. First, it is 
packed with illustrative protocols of sentence com- 
pletions by persons described in sufficiently relevant 
detail for the reader either to check his own inter- 
pretations, or to determine for himself whether or 
not the responses really have the flavor of genuine 
clinical utility. Second, it contains an extensive case 
interpretation that is a model of teaching by ex- 


Note—The reviews were prepared by the Editor 
and Advisory Editors, who may be identified by 
their initials. 
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oth 
ample. Third, the book is thoroughly free kon 
clinical jargon and extravagant claims. comple- 
and Miale overtly deny that the sene model 
tion method is a “test,” constructed on A tas 
of a yardstick or a clock, and argue ma that 0 
involved in using sentence completions 15, appro- 
sensitive interpretation, not of scoring. This 5 poini 
priate frankness leads them to emphasize rumen 
that the clinician is actually part of the mieta 
in the sentence completion technique, as En om a 
all projective devices. It leads them away 1" f 
particule? 
cen- 
stems. As a result, they implicitly raise the ma . 
tral issues of what attributes characterize, al psy” 
petent clinician and to what extent Benet e 
chology may accept Thorndike’s dictum a je 
measurability of all things. That HolsopP 
Miale do not deal directly with these po in 
hardly to their discredit, They have faced intim? 
a context that is instructive, reflective of an aa j b; 
and sympathetic knowledge of the dinici logis" 
and fruitfully suggestive for all clinical p 

who take their obligations seriously —E. J+ j 
z Oxfor 

Lewis, Hilda. Deprived children. New Kork Q 
Univer. Press, 1954. Pp. xvii + 163. $1.55. e 


This is a report of 500 children who antere per 
Mersham Reception Centre in Kent, ae am 
tween October, 1947 and July, 1950. The us ure 
Reception Centre was organized to serve i il- 
poses: first, to plan what would be best for E bt 
dren entering, and second, to gather data that cial 
throw light on factors that were causing bee not 
maladjustment of these children. The book tè en 
only the condition of the children when they als? 
tered the Centre, with their backgrounds, but two 
gives the results of a follow-up study made or 
years later. The follow-up study is especially ain 
esting, both as to the methods used in obta 
data and the results—B. M. L. 


s t 
Lowenfeld, Margaret. The Lowenfeld Mosaic Ti 
London: Newman Neame; and New York: -es 
chological Corp., 1954, Pp. 360 + 144 color Pl? 
(boxed). $10.00. ic 
Lowenfeld’s manual for her well-known Most 
Test deals comprehensively with its nature an the 
ministration, the definition and classification of n 
designs produced, and the clinical implications draw” 
from its results. The standard directions for adminis 


ia 
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New Books and Tests 


tration, and especially the definitions and illustra- 
tions of the terms used to describe the designs, are 
useful to both clinical and research workers. At last 
they now will have a uniform method for com- 
municating about the Mosaic. The 144 color plates 
make concepts clear that are hard to describe in 
Words or even in uncolored illustrations. In its 
clinical sections, the book displays honest confusion. 
Numerous case studies give, by implication more 
than direct assertion, the “typical” designs pro- 
duced by patients with many syndromes, children of 
various developmental stages, and people of several 
cultures, In discussing generalities, the author some- 
times makes glowing claims—“. .. the L. M. T. 
often makes it possible to make a rapid and certain 
diagnosis in cases of doubt...” (p. 246)—and 
Sometimes shows awareness of the limitations of her 
Method—", , , differential diagnosis between a se- 
vere degree of neurosis, a low level of inherent in- 
telligence, and severe schizophrenia, is one of ex- 
treme difficulty, since in all three cases subjects are 
‘pt to...” (p. 146). A striking omission, all too 
familiar in books on new clinical techniques, is even 

© simplest evidence on validity, other than anec- 
Stes. Is it too much to ask that authors at least 
count and report the percentages of hits and misses 
aoe by the test when predicting certain verifiable 
tagnoses or other events?—L. F. S. 


McNemar, Quinn. Psychological statistics. (2nd Ed.) 
New York: Wiley, 1955. Pp. vii + 408. $6.00. 

A Like the first edition (J. consult. Psychol, 1949, 
» 308), the revision of McNemar’s Statistics re- 

Bas a clear and precise resource for ue 
d reference, Changes include some expansions an 
vätrangements to make the text less difficult, a new 


oS x lysis of 
“Ment of interaction in complex analysis, 0” 
odan ce, and a short but useful chapter on distribu: 


“Nee methods.—L. F. S. 
Mech, Paul E, Clinical versus statistical canoe 
inneapolis: Univer. of Minnesota Press, b 
P. x + 149, $3.00. tistical 
of ,cthl’s essay on the clinical and the tor several 
Ye; Which many of us have heard rumors k r. It is 
a a" proves to have been worth waiting, ded and 
Superb piece of thinking, at once saien us and 
wita ating, profound and readable, e of se- 
First, he clears away some e the statisti- 


anti inici ani aaa 
Cal, Mics that have kept eager er constructively- 


Seco 


ae ? 
a of clinical activity, in 2 chaps ibution. Third, 
hel the book’s most distincti 


$ shock to find how meager is f 
es € twenty studies are Ph as aca 
ign, others deal with issues S 1g regard as pe- 
fiction that most clinicians k sor of the actuarial 
pPheral, The studies find 3 fa they point clearly 


b 
Method, at least by a shad 
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to the need for more and better research. Pro- 
ponents of both the statistical and clinical approaches 
need to read this little volume. And let neither side 
misperceive the author as being in the camp of the 
enemy; he has much to teach all of us. Read and 
see for yourself.—L. F. S. 


Rubinstein, Eli A., & Lorr, Maurice. (Eds.) Survey 
of clinical practice in psychology. New York: In- 
ternational Universities Press, 1954. Pp. xvii + 
363. $6.00. 


The purpose of this volume is to offer “a compre- 
hensive description of the function and role of the 
clinical psychologist.” It does this by getting some 
32 contributors from various clinical fields “to dis- 
cuss the relationship of clinical psychology to the 
particular setting in which he practices and to de- 
scribe the functions of the clinician which character- 
ize his operation in that setting or organization.” All 
the typical clinical settings are represented, and the 
list of contributors reads like a Who’s Who of clini- 
cal psychology. If we start in alphabetical order 
with the list of contributors, we find Bobbitt writ- 
ing on the Public Health Service, Brewer on the 
Wichita Guidance Center, and Brotemarkle on the 
University of Pennsylvania Psychological Clinic; 
and so on! Such compendia are often thrown to- 
gether hurriedly of second-rate contributions. This 
one is an exception. It is obvious that both the au- 
thors and the editors have put their hearts into 
their work. The result is excellent. It is of course a 
fine reference book, but it also makes stimulating 
reading. This reviewer would label it a “must” for 
every clinician’s bookshelf. —W. A. H. 


Schafer, Roy. Psychoanalytic interpretation in Ror- 
schach testing. New York: Grune & Stratton, 1954. 
Pp. xiv + 446. $8.75. 

Believing that “. . . much of today’s most impor- 
tant theoretical and clinical progress in the study of 
personality is being made through psychoanalytic 
ego psychology,” and that, in the Rorschach, “Score 
analysis is minimal analysis,” Schafer proceeds to 
demonstrate that Rorschach interpretation can be 
tremendously enriched by the application of the 
concepts of psychoanalytic psychology. Interwoven 
throughout the book is a simplified exposition of 
some of the basic psychoanalytic concepts, but the 
application of these concepts to Rorschach inter- 
pretation is very much deeper. There is an excellent 
chapter on interpersonal dynamics in the test situa- 
tion—a subject too often neglected in Rorschach 
literature—and another worth-while chapter on the 
theory of the Rorschach response process, also 
within the framework of psychoanalytic psychology. 
Rorschach workers will find the discussion on con- 
tent analysis, called “thematic analysis” by Schafer, 
rewarding. A large portion of the work is devoted 
to psychoanalytic defense mechanisms, studied in 
relation to Rorschach responses; “obsessive-compul- 
sive defense operations” are included among them. 
The detailed case presentations add substance to 
these discussions—M. K. 
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Test 


Edwards, Allen L. Edwards Personal Preference 
Schedule. College-adult. 1 form. Untimed, (40) 
min. Booklet ($3.00 per 25) with template, 
manual, pp. 18; answer sheet and profile ($2.90 
per 50); specimen set (60¢). New York: Psycho- 
logical Corp., 1953, 1954. 

Edwards has presented an ingenious and novel in- 
strument for personality assessment which will surely 
evoke wide comment, considerable clinical use, and 
much research. The Schedule is designed in terms of 
15 of Murray’s manifest needs—achievement, defer- 
ence, order, exhibition, autonomy, etc—each of 
which is paired twice with each of the others. The 
225 forced-choice items each consist of a pair of 
alternatives carefully equated for social desirability. 
As a result of this unusual and valuable matching, 
only two of the need scores have correlations with 
social desirability significantly above zero and these 
two are low (.32). The PPS thereby sidesteps that 
pitfall of many questionnaires, ego involvement. Be- 
cause the need scales are short, the modest reli- 
abilities are not unexpected: internal consistencies 
range from .60 to .87, and retest correlations from 
74 to .88. The subscore intercorrelations are low. 
The validity of such a schedule is not easily ex- 
pressed in simple terms, but the manual contains in- 
teresting data on clinical observations, and on rela- 
tionships with ratings and other questionnaires. It 
is a long time since this reviewer has seen a ques- 


tionnaire that seems to possess such potentialities for 
use and research.—L., F. S. 


Books Received 


Adams, Donald K. The anatomy of personality. 
Doubleday Papers in Psychology, No. 11. Garden 
City, N. Y.: Doubleday, 1954. Pp. vii + 44 (pa- 
per). 85¢. 

Allen, Robert M. Elements of Rorschach interpreta- 
tion. New York: International Universities Press, 
1954. Pp. 242. $4.00. 


Balint, Alice. The early years of life. Š 
Basic Books, 1954. Pp. viii + Ean po 

Bernstein, Arnold. On the nature of psychotherapy. 
Doubleday Papers in Psychology, No. 12. Garden 
City, N. Y.: Doubleday, 1954. Pp, ix + 36 (pa- 
per). 85¢. 

Blum, Lucille Hollander, Davidson, Helen H, & 
Fieldsteel, Nina D. A Rorschach workbook, Ne 
York: International Universities Press, 1954. Pp. 
iv + 167 (paper). $2.00. Fi 

Coleman, Lester L, Freedom from fear. New York: 
Hawthorn, 1954. Pp. 285. $3.95. 

Cowell, Roberta. Roberta Cowell’s story, New York: 
British Book Centre, 1954. Pp. ix + 208. $3.00. 
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Deutsch, Felix, & Murphy, Wiliam F. The clinical 
interview. Vol. 1. Diagnosis. New York: Interna 
tional Universities Press, 1954. Pp. 613. $10.00 

Duvall, Evelyn Millis. In-laws: pro & con. “400 
York: Association Press, 1954. Ep. viii + j 
$3.95. 

Ferm, Vergilius. A dictionary of pastoral psychology: 
New York: Philosophical Library, 1954. Pp. ™ 
336. $6.00. 

Gondor, Emery I. Art and play therapy. Double 
Papers in Psychology, No. 10. Garden City, K 
Doubleday, 1954. Pp. x + 61 (paper). 856 jn 

Hadamard, Jacques. The psychology of inven jh 
the mathematical field. New York: Dover | $2.50 
cations, 1954. Pp. xiii + 145. $1.25 papers 
cloth. b 

Hall, Calvin S. A primer of Freudian psycholesh: 
Cleveland and New York: World Publishing 
1954. Pp. xii + 137. $2.50. a ie 

Heckler, Edwin L. The meat packing induska vA 
cational and Professional Monographs, 1954: 
Cambridge, Mass.: Bellman Publishing Co» 

Pp. 23 (paper). $1.00. 5 jamiliolt 
Husquinet, Albert. L'adaptation scolaire et é ociété 
des jeunes garçons de 12 à 14 ans. Paris: 19 

de l'Edition “Les Belles Lettres,” 1954. PP- 
17. ory: 

Keller, Fred S. Learning: reinforcement den 
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Kaan, ie F. What is electroshock ner, 
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A Lobotomy Prognosis Scale’? 


Wesley C. Becker and Robert L. McFarland 
VA Hospital, Palo Alto, California 


Since the development of the prefrontal 
lobotomy technique by Moniz in 1936 and 
lts introduction into this country by Free- 
Man and Watts, much effort has been devoted 
to evaluating this therapeutic method. From 
7 Psychiatric viewpoint, evaluation has cen- 
ered on selection of suitable candidates for 
obotomy and on assessment of the changes 
produced by the operation. In this paper we 
te Concerned primarily with the problem of 
Se ection, 

A review of the literature readily reveals 

any opinions and some experimental evi- 


7 . 
eprom VA Hospital, Palo Alto, California. 
Becker selected the items of this scale, tried them 
ro; m Published case data, developed the original 
yen OSs scale and its manual, collected and ana 
d the Canandaigua data, and served as a rater 
the Palo Alto study. McFarland was 1n charge 
Sery, © collection and analysis of the Palo ee ae 
Vis èd as a rater at Palo Alto, and prepared the 5 
S “d scale titled the Palo Alto Lobotomy Prognos! 
fag, and its manual. Dr. K. P. Jones and M 
Hansen served as raters in the Palo Alto 
eparation of a pre- 
he authors wish to 
s- during the 
r his as- 
Robert 


Stu, 
li dy and cooperated in the pr 


than report of that study. TI 


si Y Phases of this study, S. D- Schultz fo: 
E, poe in making the impro 
tion, (lings for his help in tera 
the > Mary Ann Swanson for he: hos- 
Dit Study, and, finally, the managers o! ihe VA Dika, 
als at Canandaigua, New York, ane 

aa nia, who made this study Pee al workers to 
min, thority is granted for profession” Mto Lobo- 
to “ograph, for their own use aed of the test 
for, Y Prognosis Scale data sheets. CoP 


have 
r d manual ha 
been > template, conversion table, P Documentation 


1 deposit ith the American Aux- 
aistitute: Order Document No. 4468 from ADT ra 
te Publications Project, Photoduplica ae 
ee Library of Congress, Washington a $3 75 for 

itting in advance $2.00 for microfilm tie f, Photo- 
photocopies. Make checks payable to Chief, 
“Dlication Service, Library of Congress- 


dence on factors related to improvement 
after lobotomy. For example, such factors as 
the tortured self-concern syndrome, rapid 
onset, lack of deterioration, and good pre- 
morbid adjustment have been repeatedly re- 
ported as favorable prognostic indicators. 
The primary methods used in gathering such 
data are the psychiatric interview and his- 
tory, illustrated by the studies of Partridge 
(5) and Greenblatt eż al. (2); and psycho- 
logical testing, such as by Scherer’s (6) study 
of memory, abstraction, and motor function- 
ing. Though the literature abounds with signs 
and some significant differences to guide in 
the selection of lobotomy candidates, there 
has been no systematic attempt to quantify 
the data in the form of a prognosis scale and 
to test the predictive validity of such a scale. 
This lack prompted the present study. 

This study attempted to construct a prog- 
nosis scale to permit more precise identifica- 
tion of patients who would improve as a re- 
sult of prefrontal lobotomy. To do so (a) 
the pertinent literature in the field was sur- 
veyed to find promising items of predictive 
significance; (5) these items were tried on 
certain published case histories; (c) the items 
which survived this procedure were combined 
into a preliminary scale and then used to 
evaluate, postdictively, 55 lobotomized pa- 
tients at the VA Hospital, Canandaigua, New 
York; (d) the scale was then cross validated, 
the stability of the cutoff score was tested, 
and rater reliability was established for the 
scale on 60 lobotomized patients at the VA 
Hospital, Palo Alto, California; and finally 
(e) the scale was revised and improved by 
essentially repeating steps c and d. Only the 
final form of the scale, titled the Palo Alto 
Lobotomy Prognosis Scale, is described here. 
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Methods and Subjects 
Preliminary Prognosis Scale 


A preliminary scale of 32 items was con- 
structed from factors found to have some 
predictive value by Greenblatt e¢ al, (2) in 
their study of 205 lobotomy patients at the 
Boston Psychopathic Hospital. This source 
for the initial pool of items * was selected be- 
cause of the comprehensiveness of the vari- 
ables rated, the relative ease with which the 
data for rating could be obtained, and the 
general agreement of the Boston study with 
other studies. The items included aspects of 
premorbid personality, history, preoperative 
psychological functioning, behavior, and psy- 
chiatric diagnosis. Three mental status items 
were converted from ratings to psychological 
test scores. Other modifications of item defi- 
nitions were made when necessary to increase 
clarity. 

A trial run of the 32-item prognosis scale 
was made using data contained in 24 pub- 
lished case histories from the Columbia-Grey- 
stone study of cortical ablation (4). Some 
items were dropped because of their overde- 
pendence on the nature of the sample (e.g., 
religion, age, occupation). Others were modi- 
fied or eliminated because of difficulty in rat- 
ing or lack of a significant trend. The results 
were generally encouraging and 23 items 
were retained for further study. 


Scale-Construction Study 


To test the discriminating power of the 23- 
item prognosis scale and to determine a use- 
ful cutting score, it was applied in July, 1953 
to the records of 55 male neuropsychiatric 
patients lobotomized consecutively at the VA 
Hospital, Canandaigua, New York, between 
1948 and 1951. The scale items were rated 
from data in the clinical folders such as doc- 
tor’s progress notes, board reports, social 
service reports, psychological reports, and 
nurses’ notes. Where data were lacking, the 
total score was prorated on the basis of rat- 
able items. 

Criterion improvement ratings. Since the 
purpose of the study was to postdict improve- 
ment or nonimprovement of behavior of lo- 

4 The word “items” is used for convenience only. 


Actually we are d g with dichotomized continu- 
ous variables in many instances. 


Wesley C. Becker and Robert L. McFarland 


botomized patients, it was necessary to have 
a criterion measure which would assess both 
preoperative and postoperative behavior of 
these patients and which would yield some 
quantified measure reflecting the degree 0 
change, if any. Ratings of improvement two 
to five years after operation were made on 
the basis of the following scale, borrow 
from the Columbia-Greystone study (2, P- 
389): 


Rating of 5—on most disturbed ward. 

Rating of 4—on moderately disturbed ward. 

Rating of 3—still institutionalized but on 
privileges. 

Rating of 2—at home under supervision. ble of 

Rating of 1—at home and working or capa 
working. 


ground 


$ be- 

The improvement measure was the Lees 3 
tween the postoperative and preoperative = of the 
one bonus point (if appropriate) for eac 


following postoperative characteristics: 


ound 
a. A change from a most disturbed ward to g" 


parole. p 
b. A move from any place in the hospital to 
c. The ability to work at reduced capacity. 
d. The ability to work at former capacity. 


home 


The maximum possible score was 8. 


The improvement criterion had shortcom 
ings, but for the population for which it ‘a 
designed and used, it appeared to be ri a 
tive enough to allow gross evaluation 0 
provement. re 

Malignancy rating. A third measure, 4 P to 
operative malignancy estimate, was made 
shed further light on the nature of the Pf dy 
nosis scale. In the Columbia-Greystone St" “3 
(2), it was found that malignancy ra 
correlated moderately with improveme ft 
Data obtained in applying the 32-item 4°” 
of the prognosis scale to the Greystone sa be 
ple suggested that this estimate might y 
thought of as a crude measure of malignane? 
when malignancy is defined and rated as $0 
lows (2): 


1, Purely affective psychosis. t, 

2. Schizophrenic features plus considerable affech 
little or no deterioration. r 

3. Schizophrenic features with deterioration, little ° 
no affect, inappropriate affect. 


It was tentatively assumed that these COP” 


cepts crudely reflect an underlying trait co“ 
tinuum. 


A Lobotomy Prognosis Scale 


Cross-Validation Study 


aes of the Palo Alto study was es- 
cept id the same as that at Canandaigua ex- 
feliabili provision was made to check the 
aed Of the prognosis and criterion im- 
ment ta = ratings, and to have the improve- 
Taters ings made by different judges. Four 
Kion ea each assigned 30 records from 
botomie first 60 patients who received lo- 
lets es a the VA Hospital, Palo Alto. The 
mate ia uded a staff psychiatrist of diplo- 
a staff atus, a staff psychiatric social worker, 
tainee Poyehologist, and a clinical psychology 
Patient wo judges independently rated each 
Scales na the prognosis and malignancy 
case S A average rating was used in each 
Search the statistical computations. A re- 
o etant rated each patient on the 
chologi ment scale and a second staff psy- 
ability St rerated the first 29 cases for reli- 
and M purposes. One brief training session 
gui grreliminary, rating manual were used 
ide the prognosis ratings. 


escribe 
cription of the Samples 


Sioa Population characteristics of the Can- 
Ta ie and Palo Alto samples are given in 
Pears “ae the malignancy ratings, it ap- 
Somewh, at the Canandaigua sample was 
differe at more deteriorated as a group- The 
mi a improvement rates for the two 
Ples is partly accounted for on this basis. 


p" of the Scale 
2 the basis of a chi-square item analysis 
ble rap scale was revised. Using the avait- 
ata from three populations (Greystone, 
3 ndaigua, Palo Alto), 14 of the 23 items 
Significant beyond the .05 level and 
© included in the final form, called the 
leet Lobotomy Prognosis Scale. Two 
‘onal items (sociability prior to illness 
thoy Undertalkativeness) were also retained, 
can gh they did not show statistical signifi- 
Enthy ` Since these items have been consist- 
a4 found of value in other studies (9), id 
dieg Clt that with predictive rather than POS 
tate Ve use of the scale, the data necessary 
Thi these factors reliably would be available. 
Tte S assumption will have to be tested later. 
kings eliminated from the scale were of two 
S: items on which nearly all lobotomy 
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Table 1 


Selected Population Characteristics of the Scale Con- 
struction and Cross-Validation Samples 


Canan- Palo 
. daigua Alto 
Variable sample sample 
WF 55 0 
Age in years 
peat 35.0 304 
Sigma 9.4 11.3 
Range 22-58 23-66 
Years from first 
hospitalization 
Mean 6.2 11.2 
Sigma 4.2 81 
Range 1.5-25 2.2-34.9 
Years since operation 
Mean 3.7 3.1 
Sigma 96 1.12 
Diagnosis 
Schizophrenic reaction 
Paranoid type 24 23 
Catatonic type 13 12 
Hebephrenic type 14 18 
Mixed type 3 3 
Manic-depressive reaction 
Manic (chronic) type 1 0 
Depressed type 0 3 
Malignancy rating 
1 0 2* 
2 19 27° 
3 36 31* 


— 


+ Average of two raters. 
patients scored in the same direction, and 
items of extremely low reliability. The items 


of the final scale stated in a prognostically 
negative direction were as follows: 


No previous remissions (not home 3 months or 
more) (1) 5 

2. Irritable prior to illness (1) 

3. Not sociable prior to illness (1) 

4, Failure to show temporary moderate to marked 

improvement following convulsive shock ther- 


apy (2) 
5. Undertalkative speech (1) 
6. Incoherent ramblings and “word salad” speech 


1. 


(1) 
7, Appearance shabby ( 1) 
g. Presence of auditory hallucinations (2) 
9. Absence of awareness of mental disorder (1) 
10. Absence of elated, depressed, or anxious affect 
(2) 
11. Presence of flat, apathetic mood (2) 
eT T *, 
5 Weights are indicated in parentheses. Instructions 
for rating these items and for determination of prog- 
nosis scores are contained in th anual referred to 


in footnote 3. 
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12. Disoriented to time, place, or person (1) 

13. Wechsler-Bellevue Arithmetic weighted score 6 
or under (1) 

14. Wechsler-Bellevue Information weighted score 6 
or under (1) 

15. Wechsler-Bellevue Memory Scale 80 or under 
2 

16. see "cama diagnoses only are weighted as 
indicated: 
a. Involutional psychosis (0) 
b. Manic-depressive, depressed (0) 
c. Manic-depressive, manic (chronic not oscil- 

lating) (1) 

. Schizophrenic, paranoid (1) 

. Schizophrenic, catatonic (2) 

. Schizophrenic, mixed (2) 

. Schizophrenic, hebephrenic (3) 


AMS 


This scale was again scored for both sam- 
ples and the new cutting score tested. 


Results 
The 23-Item Prognosis Scale 


Reliability. Rater reliability of the 23-item 
preliminary prognosis scale was found to be 
-88 on the Palo Alto sample. Rater reliability 
of the criterion rating was .92 for the first 29 
cases in the Palo Alto sample. 

Validity data. In computing validity sta- 
tistics, two cutting scores had to be deter- 
mined, one on the improvement criterion and 
one on the prognosis scale. Successful re- 
sponse to lobotomy was defined as improve- 
ment to ground privileges or better; which 
cuts the criterion of improvement between a 
rating of 1 (“less of a management prob- 
lem”) and 2 (“has some ground privileges”). 
The effect this definition of successful lo- 
botomy has on the usefulness of the scale will 
be discussed later. The cutting score on the 
new prognosis scale was based on a com- 
promise between the best statistical predic- 
tion (maximum true positives and true nega- 
tives) and an attempt to detect as many as 
possible that might improve to criterion 

(minimum false negatives). 

If we accept an improvement to ground 
privileges or better as adequate justification 
for lobotomy, and use a cutting score deter- 
mined from the Canandaigua sample by the 
above procedure, the following validation and 
cross-validation statistics obtain: 

If the 23-item prognosis scale would be 
employed (using our cutting score) to select 
patients for lobotomy, (a) the percentage of 
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successful operations for the Canandaigua 
sample would be raised from 22 to 38%. 
Only two patients who improved to crite 
would be overlooked (false negatives), 4% ‘i 
the number of operations could be reduce 
by more than half; (b) on the Palo alo 
sample with the same cutting scores, Use : 
the prognosis scale would raise the perce 
of successes from 35 to 58%. Five patien 
who improved would be overlooked, E 
again the number of operations could be ie 
duced by more than 50%; (c) the pe 
age of successful predictions is 67% fori 
Canandaigua sample and 73% for the M 
Alto sample; ° (d) chi squares for each sa 
ple are significant beyond the .01 level. 


Palo Alto Lobotomy Prognosis Scale 


The revised scale has the same interagi 
reliability (.88) as the original scale fe 
though it is seven items shorter. aba 
data for the validation and cross-valida 
study are presented in Table 2. 

With the same procedure for det cale; 
the cutting scores as for the original are 
the following validation data obtain: (4 tof 
this scale were used to select patients of 
lobotomy operations and the cutting S the 
(as indicated in Table 2) derived fro raea 
Canandaigua data were used, the percei gu 
of successful lobotomies in the Canandes fy. 
sample would be raised from 22% to, rion 
Only two patients who improved to cnt a 
would be overlooked (false negatives) ce 
the number of operations could be redna 
by 50%. (5) On the Palo Alto sample if a 
scale were employed using the cutting 5° 
from the Canandaigua sample to select 
tients for lobotomy, the percentage of T E 
cesses would be raised from 35% to 59%» a 
patients who improved would be overlook 
and the number of operations could be mo 
than halved. (c) The percentage of succ?’ f 
ful predictions is 65 for the Canandaign, 
sample and 73 for the Palo Alto sample.’ ( 


ermining 


© With a cutting score determined from the Cane 
daigua sample to give the best statistical predict of 
the percentage of successful predictions is 737 
Canandiagua and 78% for Palo Alto. de- 

7 With a cutting score (between 10 and 11) the 
termined from the Canandaigua sample to give © 
best statistical prediction, the percentage of succes? 
ful predictions is 78% for both samples. 
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Table 2 


Distribution of Cases for the Relationship of the 
Prognosis Score to Improvement 


Canandaigua Palo Alto 
improvement improvement 
P rating rating 
Tognosis 
agorte” 0-1 28 0-1 28 
ro 2 2 0 6 
fee 5 5 3 5 
reel 10 3 10 8 
me 16 1 16 1 
a8 10 1 10 1 
Total i's 43 12 39a 


Fee Low, 7 
in lepe Prognosis scores and higher improvement ratings are 
5 cvorable direction, ri 
and 15, Cutting score on the prognosis scale falls between 1 
Chi s 


uare i res indi- 
cated 1 S based on the cutting sco 


01 in Table 2 are significant beyond the 
level for each sample. 


Malignancy Ratings 
rati he interrater reliability of the malignancy 
“78S Was .70 for the Palo Alto sample. As 
Scale uesested from applying the preliminary 
Scale to the Greystone sample, the prognosis 
Th th shows a high relationship to malignancy. 
79 a anandaigua sample the biserial 7 was 
moment in the Palo Alto sample the product- 
indi ent + was .83.8 So high a relationship 
aaa that the prognosis scale is bo 
illn Ya Measure of the degree or severity 0 
“ss. If it were not for its coarse nature an 
< Teliability, the malignancy rating by 
Vice Ould be an adequate prognostic de- 
high] Tt correlates with improvement jus : 
(Pa, 7 (Pearson v, 50) as the prognosis a 
Ssa 48) for the Palo Alto samp'e- 
ta ever the prognosis scale has the ae 
tect finer differentiation leading to 9e 
“diction, 


tter 


F Implications 
“nancy and Improvement the pros- 


nos lysis of the relations between ratings 
Sis scale scores and malignancy t: 
8 “2 aligna: 

tati be fact that the correlation Lai te Malto sam- 

DI Mes and prognosis scores 0D the uld allow 1s 

Poggi’, higher than the reliabilities eoliability ob- 

tasibly a function of the in Ba Chance fac- 

ings. 
toned from averaging the two 74! 


Tay also enter. 
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strongly supports the idea that patients who 
improve as a result of prefrontal lobotomy 
are less mentally ill than those patients who 
do not profit from lobotomy. This idea is not a 
new one. Stotsky’s (7) study of remitting and 
nonremitting schizophrenics shows that re- 
mitters are more like severe neurotics on the 
Rorschach than nonremitters. The study of 
process and reactive schizophrenics by Kan- 
tor, Wallner, and Winder (3) leads to a simi- 
lar conclusion. Wittman’s work (8) with the 
Elgin Prognosis Scale also supports this the- 
sis. In the neurotic range of severity, Barron 
(1) has demonstrated that the neurotics who 
profit most from psychotherapy are better 
adjusted prior to treatment. The apparent 
truth of this thesis has the following implica- 
tions for further work in this area. First, the 
search for prognostic indicators should be 
more actively centered on variables which 
correlate with severity of illness. Items in this 
lobotomy prognosis scale suggest many areas 
for more intensive study. Second, it becomes 
essential, particularly with small samples, - 
that studies of the differential effects of vari- 
ous therapies be controlled for severity of 
illness. The prognosis scale discussed in this 
paper might be useful for this purpose with 
some severely ill populations. 


Uses and Limitations of the Scale 


a. Present validity data are limited to male 
veterans in VA hospitals referred on some 
basis other than their scores on this scale as 
lobotomy candidates. 

b. Our definition of “success” on the cri- 
terion improvement rating has a definite ef- 
fect on the utility of the prognosis scale as 
a selection device. We accept as our defini- 
tion of success an improvement to ground 
privileges or better (two or more points on 
the improvement scale). If one chooses the 
less stringent criterion of better ward man- 
agement (an improvement of one point), the 
prognosis scale has little value in selection, 
since most patients under present selection 
methods improve this much. However, if the 
patient has a negative prognosis score in 
terms of our cutoff point, the scale would 
indicate that better management would be 
the most that could be expected. Then the 
decision to operate or not, under this pre- 
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diction of limited improvement, could be 
weighed against such factors as possible de- 
fects the lobotomy operation creates, the 
surgical risks involved, and the cost of the 
procedure. 

c. A favorable score on the scale does not 
insure success from lobotomy. However, the 
probability of success, accepting our criterion 
of improvement, can be stated to parents or 
relatives who must approve the operation. It 
must be pointed out that the revised progno- 
sis scale, from a statistical standpoint, rules 
out lobotomy operation with greater cer- 
tainty than it rules in the procedure. Roughly 
speaking, a score above the cutoff indicates 
with the odds of 13 to 1 that the patient can 
be expected to show little or no improvement 
whereas scores below the cutoff indicate with 
odds of only 1 to 1 that a patient should 
demonstrate marked improvement. 

d. A final caution in the use of the scale 
involves the fact that all of the present data 
on the utility of the scale are based on post- 
dictive studies. Though there is no reason to 
believe the scale will not be useful in predic- 
tion, it has not yet been demonstrated. The 
fact that we can identify with greater cer- 
tainty those patients on whom operation 
should not be performed suggests that other 
types of psychological and/or physiological 
data are needed to identify with greater ac- 


curacy those patients who will improve as a 
result of lobotomy. 


Summary 


A series of studies was undertaken to de- 
velop and evaluate a lobotomy prognosis 
scale. Using historical, behavioral, and men- 
tal status material found to have some prog- 
nostic significance by Greenblatt et al. (2), 
we developed a preliminary 32-item scale. 
Modifications of the scale were made on the 
basis of data obtained in applying it to 24 
published case histories from the Columbia- 
Greystone study of cortical ablation. The re- 
sulting 23-item scale was then validated 
against the records of 55 lobotomy patients 
at the VA Hospital, Canandaigua, New York, 
and cross-validated on 60 lobotomy patients 
at the Palo Alto VA Hospital. Evaluation of 
improvement was made at the time of the 
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study which was from two to five years after 
operation. Finally the scale was revised on 
the basis of a chi-square item analysis of the 
data from the three samples (Greystone, 
Canandaigua, and Palo Alto). 4 
The results indicated that the prognosis 
scale predicts to a practical degree both those 
patients who are likely to improve to groun 
privileges or better and those patients who 
demonstrate little or no improvement aii 
lobotomy. The high two-rater reliability ° 
the scale, and the cross-validation stability 
of the cutting score and percentage of SUC 
cessful predictions suggested that consider- 
able confidence may be placed in the Te 
peatability of the findings. Cautions and limi 
tations are discussed in the text. , 7 
In an attempt to clarify the underlying A 
ture of the prognosis scale, ratings of ma a 
nancy were correlated with the progno a 
scores. Correlations of about .80 found 


i hat 
three samples force a strong conclusion E F. 
the prognosis scale is a refined rating © 
verity of illness. 
Received August 19, 1954. 
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sets cholonists who work in general hospital 
Patients’ requently have occasion to evaluate 
PsSychoso responses in the specific light of 

cories ne theories. Awareness that these 
€xperim ave not been subjected to rigorous 
Sistent ental confirmation causes certain per- 
Patient questions to arise, especially if some 
While chen regarded as psychosomatic cases 
Cally i ers are thought of simply as physi- 
Such as people. Are patients with diseases 
are wid asthma and ulcerative colitis, which 
Cause ay referred to as psychosomatic be- 
Cal and ey appear to have mixed psychologi- 
like Physiological etiology, actually more 
With Psychiatric patients than like patients 
More ee somatic illnesses? Are they 
Do ikely to suffer from depressed moods? 


they present characteristically distorted 
more 


Mi 

a ment and color balances and give : 
Orne, anatomy responses on the Rorschach? 
Wh T questions also arise, concerned with 
ether or not the differences in psychody- 


The data were collected at Mount Sinai Hos- 
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namics hypothesized for the distinctive psy- 
chosomatic maladies evidence themselves in 
projective test protocols. For example, are 
oral objects and processes more prominent in 
the records of asthmatics, and anal objects 
and processes more notable in the records of 
colitis sufferers? This paper constitutes an at- 
tempt at finding answers to these and other 
questions arising out of work with a diverse 


hospital population. 


Experimental Subjects and Procedures 


In order to carry out meaningful experi- 
mental comparisons of patients with psycho- 
somatic diseases, it is essential to choose dis- 
ease entities which are widely conceived of 
as within the psychosomatic category and 
which have distinctive systemic and dynamic 
features. Asthma and ulcerative colitis qualify 
in both these respects. For purposes of 
broader comparison, a group of subjects with 
a disease definitely not currently thought of 
as psychosomatic was chosen as an experi- 
mental control. Tumor patients appeared to 
qualify in this respect, for the etiology of 
malignant tumors has not been directly linked 
with psychological mechanisms or stress. Fur- 
thermore, patients with tumors are relativel 
as ill as the subjects in the other groups 4 


Subjects 

The subjects, 20 in each group, a 7 
and all 23 to 46 years of age, we PAE 
ward patients of one general hospital. The 
median age of the asthma group was 36.5, of 
the colitis group 32.5, and of the tumor group 
40.8 years. Because of a dearth of suitable 
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colitis subjects in the clinics and wards, the 
members of a hospital social club for people 
who have had ileostomies performed to con- 
trol ulcerative colitis were included in the 
colitis group. Only patients found to be cur- 
rently at least occasionally subject to asthma 
attacks were included in the asthma group. 
The colitis subjects had all been hospitalized 
at least once for ulcerative colitis. All the 
tumor patients had been definitively diag- 
nosed as suffering from malignant breast, 
uterine, abdominal, or lymphatic system tu- 
mors. No one was included whose hearing or 
sight was severely impaired or who was preg- 
nant, crippled, or receiving ACTH or corti- 
sone. Nor was anyone included who in addi- 
tion to one of the three selected diseases had 
a medical history of any other crucial dis- 
ease.* 


Psychological Tests Used 


The battery of five tests used in this study, 
which, except for the omission of a lengthy 
intelligence scale, resembles a conventional 
diagnostic battery, comprised the following: 


The Bender-Gestalt Test. The Bender records 
were scored by the experimenter in accordance with 
Pascal and Suttell’s standardization (5) after pre- 
scribed practice with their method had resulted in 
a product-moment correlation of .89 with Pascal’s 
scores for the 20 sample records in his manual. 
Pascal reports a correlation of .90 between his own 
and his collaborator’s scorings of 120 records. 

The H-T-P Test. Drawings of house, tree, and 
person were supplemented by another drawing. 
After the first human figure was finished, the sub- 
ject was requested to draw a figure of the opposite 
sex. 

The Rorschach test. The Rorschach records were 
scored in accordance with Klopfer’s method (4). 
The proportion of agreements of scoring judgments 
made by the experimenter and by another psycholo- 
gist on 20 random records ranged from .59 to .93 
for explicit agreements on individual color and 
movement determinants. When implicit agreements 
—instances in which neither scorer considered a 
response to involve a certain determinant—were 
included in the computations, the proportion of 
agreements ranged from .71 to .98 on individual 


3The subjects were screened for an acceptable 
Jevel of verbal fluency. Some differences were found 
in vocabulary scores, educational attainment, and 
ethnic composition of the groups, but these were in- 
vestigated wherever possible and found not to affect 
critically the major purposes of the study. 

4 Barbara R. Waxenberg independently rescored a 
portion of the records. 
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determinants. The human and animal movement Te- 
sponses were judged to fall into one of three cate- 
gories—active, static, or passive—in accordance with 
a classification scheme based in large measure On ul 
discussion of movement responses by Phillips an 
Smith (6, pp. 75-77). Scorer reliability on E 
classifications ranged from .76 to 1.00 on explici 
judgments and from .82 to 1.00 when implicit judg- 
ments were also taken into account, The Rorscha 
responses were also judged for oral, anal, and bony 
anatomy content. A response was considered oral u 
it involved (a) foods or beverages, (b) cule 
tools or procedures, (c) body parts related to cae 
intake, (d) oral activities such as biting, suc! ee 
and licking, or (e) states of hunger or thirst. "ae 
sponse was considered anal if it involved (a) oth 
tive functions or appliances, (b) fecal matter, e 
dirt, the implication of a morbid or disgustine ig ” 
tural quality or viscosity, or terms such as oor ite 
“squishing,” etc., or (c) posterior anatomy, oa A 
internal or external. A percept was considere ical 
bony anatomy response if it involved an anatoa 
part, either animal or human, with a speci te- 
bony structure. Scorer reliability on these e 
gories ranged from .71 to .81 for explicit judgm 
and from .98 to .99 for all judgments. 


i st of 60 
Word associations. Rapaport’s revised ry The 
word association stimuli was used (7, P- “those 


responses were judged by the same criteria anh th 
for the oral and anal Rorschach content, a for 
number of each kind of response was totale ore 
each subject. Twenty random records were re of 
by another judge. The two scorers agreed re jm- 
the oral and .82 of the anal responses. wit 
plicit agreements included, the over-all agree’ 
was .97. ds 

The Thematic Apperception Test. Ten man Gs 
(1, 2, 3BM, 4, 8BM, 12M, 13MF, 15, 18GF) yas 
always in this order, were used, Each story aE 
rated for emotional tone in accordance with @ su 
devised by Eron (2, Appendix A). An algebraic s ol 
was computed for the ratings of the ten storie: 
each subject. The resultant score for every one a 
the 60 subjects was negatively signed, indicating 
weighting toward sad stories, which also prev% 
in Eron’s studies. Because of this uniformity, 
signs were dropped and a set of mood score: a 
obtained which ranged from 1, indicating a neY Ja 
tone, to 14, reflecting a rather deep dysph o er 
Twenty random records were rescored by ano wo 
judge. The product-moment correlation of the A 
sets of ratings was .82. Eron obtained correlati? 
of .86 between raters in his own studies (2, 3)- 


Hypotheses and Results 


Certain hypotheses were implied in the 
questions raised in the introductory pa! 
graph. These and other hypotheses suggest® 
by theories and intuitions about personality 
dynamics which are applied and found e0 
Pirically useful in clinical work are het 
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Stated explicitly and tested by statistical 
methods. 


Psychiatric Patient Status on the Bender- 
Gestalt Test 


Pascal’s scoring method for the Bender- 
Gestalt (5), which differentiates psychiatric 
clinic and hospital patients from nonpatients, 
Was used in this study to test the hypothesis 
that the behavior of a person suffering from 
à psychosomatic disease is more likely to re- 
Semble the behavior of a psychiatric patient 
than is the behavior of an individual with a 
disease which is not spoken of as psychoso- 
Matic. All subjects were dichotomized ac- 
cording to their standard scores, with a score 
of 67, the point at or beyond which only 5 in 

0 normal persons’ scores would be expected 
to fall, serving as a cutoff point. Low scores 
Which placed them in the nonpsychiatric 
category were obtained by 7 asthma, 13 
Colitis, and 5 tumor subjects. The balance of 

he 20 subjects in each group fell in the class 
resembling psychiatric patients. When the 
asthma and colitis groups were compared by 
Cù square, a significant difference did not 
&PPear.® Since they could then be regarded 
aS drawn from the same population, they were 
Combined into a composite psychosomatic 
Stoup for comparison with the control tumor 
Soup. The difference between these groups 
Pas not significant either, Hence, it cannot 
© Concluded that people with peyeho o aaan 

'Seases differ from other ill people in respec 

° Psychiatric status. i 
Mooa Scores on the Thematic Apperceplion 
Test 


Eron’s rating scale for 
responses was designe 


“tween stories expressive 0 


A ome, 
Š ries of fearsor, 
spent expectations and sats associated with 


_strating, and violent even esignation. Psy- 
lings of guilt, regret, and e are to be 
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immobilized by conflicting needs and motiva- 
tions which produce dysphoria. The hypothe- 
sis that such patients are more subject to 
dysphoric moods than are other sick people 
was tested by means of dichotomization of 
the subjects on the basis of TAT mood 
scores falling above or below the median of 
9.4. Scores indicating greater dysphoria than 
the median score were obtained by 10 asthma, 
11 colitis, and 8 tumor patients. Group com- 
parisons by means of chi square, similar to 
those described in the preceding section, pro- 
duced no evidence to indicate that dysphoria 
is more commonly a concomitant of psycho- 
somatic illness than of other physical illness. 


Sequence and Size of Male and Female Fig- 
ure Drawings 


In psychosomatic formulations, asthmatics 
are regarded as passive, dependent, and very 
much identified with supportive maternal fig- 
ures, while women afflicted with ulcerative 
colitis are regarded as assertive and domi- 
nating and often career oriented. The per- 
sonal projections obtained in human figure 
drawings were used to test these psycho- 
sexual differentiations. It was hypothesized 
that women asthmatics, in carrying out the 
figure-drawing task, draw the female figure 
before the male figure and tend to draw the 
female larger in vertical dimension than the 
male figure, while women with ulcerative co- 
litis reverse the process, drawing the male first 
and larger. The female was drawn first by 13 
asthma, 16 colitis, and 14 tumor subjects. 
Pairs of figures were regarded as similar in 
size whenever the difference in their vertical 
dimensions, measured to the nearest half 
centimeter, was less than 1.5 centimeters, In 
only 39 cases were there differences this large 
or larger. The female figure was drawn larger 
by 11 asthmatics as against 4 who drew the 
male larger, by 6 colitis patients as against 6 
who drew the male larger, and by 10 tumor 
patients as against 2 who drew the male 
larger. When the asthma and colitis groups 
and then the combined Psychosomatic and 
control groups were compared on each of 
these variables by means of chi square, no 
significant differences emerged. 
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Hypotheses Concerned with Rorschach Meas- 
ures 


Consideration was given to the factor of 
total productivity before counts of Rorschach 
determinants were used for testing experi- 
mental hypotheses. The number of responses 
in each of the 60 Rorschach records ranged 
from 7 to 43. The median fell between 15 
and 16. Fewer than the median number of 
responses were given by 14 asthma, 10 colitis, 
and 9 tumor patients. Chi squares offered no 
basis for doubting the homogeneity of these 
groups with respect to total responsiveness. 
However, since the number of responses in 
an individual record is correlated to some ex- 
tent with each of the major determinants, it 
is advisable wherever practicable to examine 
each hypothesis in such a way as to impose 
a degree of control on productivity. The 
method adopted here is to test a hypothesis 
first with only those records containing fewer 
than the median number of responses, then 
repeat the test with only those records hav- 
ing more than the median number of re- 
sponses, and finally repeat the test using all 
the records. 

Coarctation. When both the total of hu- 
man movement responses and the weighted 
color sum fail to exceed one, a record is con- 
sidered to be coarctated. Observation in psy- 
chiatric clinics devoted to treatment of psy- 
chosomatic cases suggests a prevalence of 
coarctation in Rorschach productions of this 
group. The question arises, however, whether 
it is primarily a matter of the patient’s being 
physically il in general or a matter of his 
having a disease regarded as psychosomatic. 
It was here hypothesized that Rorschach rec- 
ords of psychosomatic patients are more 
likely to show coarctation than are the rec- 

ords of other physically ill persons. Coarcta- 
tion was found in the shorter records of five 
asthma, three colitis, and four tumor pa- 
tients and in the longer record of one tumor 
patient. Chi squares revealed no significant 
differences in comparisons of the asthma and 
colitis groups or of the combined psychoso- 
matic and control groups, when shorter or 
longer or all records together"were considered. 

Human movement and color. response paf- 
terns. Instead of the coarctative manifesta- 
tions described above, a somewhat different 
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patterning of color and human movement re- 
sponses is considered by Phillips and Smith 
(6) to typify the psychosomatic patient. 
Their assertions are embodied in the hy- 
pothesis that psychosomatic patients typi- 
cally give no more than one human move- 
ment response but obtain weighted color 
sums of between three and five. The number 
of subjects in this study who show pre- 
cisely this pattern is very small. Three oe 
bers of the control group produced the pa 
tern in longer records; one asthma and TA 
colitis patients did so in shorter records. pi 
further testing of the hypothesis, the tw 
components of the pattern were investigate? 
separately. Of those producing shorter E. 
ords, 13 asthma, 8 colitis, and 9 tumor ra 
tients obtained color sums of less than thre j 
while 1, 2, and 0 patients, respectively, e 
tained color sums of between three and 
Of those producing longer records, 5 ast Noe 
1 colitis, and 5 tumor patients obtained S 
sums of less than three; while 1, 7, 3" a 
respectively, obtained color sums of pein 
three and five. The total color sums were E $ 
54.5, and 48.5 for the respective groups. of 
longer colitis records and one longer tun 
record show color sums between 5.5 aP the 
These three records were excluded from ine 
tabulations; however, had they been ald 
cluded, the same statistical results WO ec’ 
have been obtained. When the shorter F 
ord asthma and colitis categories were be 
pared and when they were combined for CO" it 
parison with the control group, no significa 
chi squares were obtained. When the lona 
records, or all the records, of the asthma *i 
colitis subjects were compared, howeve!, G 1 
squares significant at better than the .05 a 
of confidence were obtained, indicating t 
colitis subjects are more likely to give rA 
merous color responses than are asthmatl© 
Comparisons of the tumor group with t 
asthma group and with the colitis group, eat 
taken separately since lack of homogeneity 
forestalls combining them, offered no evidenc” 
of differences between the individual psycb? 
somatic groups and the control group. í 
Now, what may be said of the other hal 
of the pattern? Of those producing shorte? 
records, 8 asthma, 7 colitis, and 7 tumor P3” 
tients gave one M response or no M at alli 
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while 6, 3, and 2 patients, respectively, gave 
more than one M response. Of those produc- 
ing longer records, 5 tumor patients gave no 
more than one M response; while 6, 10, and 
6 patients, respectively, gave more than one 
M response. The respective groups produced 
totals of 51, 47, and 28 M responses. When 
Comparisons similar to those described above 
were made on the human movement variable, 
only one significant difference was found, 
that between the longer record subjects of 
the composite psychosomatic group and of 
the control group. However, the direction of 
the difference was opposite to that hypothe- 
Sized. About half of the 11 control group 
Subjects who gave longer protocols fall in 
the 0-1 M category, whereas not one of the 
16 psychosomatic subjects who gave longer 
records had such a small number of M re- 
Sponses, From all these findings, there would 
appear to be very little reason for believing 
that the color-movement pattern proposed by 

hillips and Smith is characteristic of psy- 
Chosomatic records. 

Active and passive ideation in movement 
responses, Human and animal movement re- 
SPonses on the Rorschach were separately 
lifferentiated as being active, static, or pas- 
“Ve for the purpose of testing the adeno 

at asthma patients predominantly ee 

asic passivity and dependency needs while 
Colitis patients reflect rather strong strivings 

aggressive drives in their fantasy pro- 
‘Uctions. After rather complex categoriza- 
tions were made, chi-square tests on the tA 
Sultant data brought to light no significan 
Merences between the groups. Static 

Static human movement responses. _ hibi- 
human movement responses reflecting M sion 
tion of hostile activity and resultant ae 
n situations of conflict between activity an 
Passivity indicate psychosomatic Sy? (6, P- 
tology according to Phillips and en onses 

). The median number ad 1 for the sub- 
Per record was between 0 an ecords of two 
Jects of this study: aie tumor sub- 
asthma, eight colitis, a static M re- 
Jects contained at leet Rie were 
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matic patients are more likely to produce 
static M’s than are other physically ill 
people. 

Bony anatomy. In an extensive review of 
types of Rorschach content, Phillips and 
Smith (6, pp. 124-127) declare that bony 
anatomy content is an index of the extent to 
which psychosomatic patients are engaged in 
inhibiting the expression of hostile impulses 
which are ultimately expressed through soma- 
tization. The hypothesis that psychosomatic 
subjects are more likely to produce bony 
anatomy responses than are other sick per- 
sons was tested by classifying the subjects 
according to whether they gave no bony 
anatomy responses or at least one bony 
anatomy response, the median lying between 
these limits. One or more such responses were 
given by 11 asthma, 9 colitis, and 11 tumor 
patients. The responses total 24, 11, and 32 
for the respective groups. Chi squares gave 
no evidence of significant differences. 

Oral and anal Rorschach content. It is hy- 
pothesized that asthmatics, considered to be 
conflictually absorbed with problems of suc- 
corance and maternal protection, fill their 
Rorschachs with inordinate amounts of oral 
content, while colitis patients produce an un- 
usual amount of anal content, either as an 
expression of deep, hidden preoccupations 
and motivations or as a reflection of pressing 
concern with the problem of fecal elimina- 
tion. The median number of oral responses, 
and also of anal responses, for all subjects 
was between O and 1. One or more oral re- 
sponses were given by 9 asthma, 10 colitis, 
and 11 tumor patients, for group totals of 
12, 21, and 20, respectively. One or more anal 
responses were given by 1 asthma, 1 colitis, 
and 5 tumor patients, for group totals of 1, 
3, and 12. Chi-square tests revealed no sig- 
nificant differences, 


Oral and Anal Responses to the Word As- 
sociation Test 


The hypothesis involving oral and anal re- 
sponses was also investigated by means of a 
84) in which the 


word association list. 4 
made_on__tetak rane ee suckctesponses bulks much 
1 


‘becexpected to afford a 
mn of the groups. Oral re- 
sponses ranged, from 3 to 13 per record, with 
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the median between 8 and 9. More than 8 
oral responses were given by 10 asthma, 11 
colitis, and 11 tumor patients. Group totals 
were 177, 174, and 172, respectively. The 
number of anal responses ranged from 0 to 
5 per record, with the median between 2 and 
3. More than 2 anal responses were given by 
7 asthma, 10 colitis, and 9 tumor patients. 
Group totals were 42, 52, and 52. Chi-square 
tests failed to sustain the hypothesis derived 
from psychodynamic and symbolistic theoriz- 
ing about the expression of fixated pregenital 
oral and anal drives. 


Discussion 


The primary purpose of this study was to 
lend the support of experimental evidence to 
clinical impressions about people with psy- 
chosomatic diseases. It is widely held that 
they constitute a unique group, different 
from normal, healthy persons as well as from 
persons physically ill in the ordinary sense. 
Moreover, the psychodynamic forces at work 
in various such diseases are said to differ in 
particular ways. By means of a conventional 
test battery, these assumptions were investi- 
gated, without any evidence for their sound- 
ness being adduced. Such consistently negative 
findings cast doubt upon the basic formu- 
lations which set the direction for psycho- 
somatic practice, therapeutic as well as diag- 
nostic. The selection of a presumedly normal 
but physically ill, rather than a normal and 
physically healthy, control group placed the 
focus on two polarities of physical illness, 
psychosomatic and nonpsychosomatic. An at- 
tempt at delineating the differences between 
the two has rendered questionable the theo- 
retical differentiations which have been posited 
in the literature. Dunbar, almost twenty 
years ago, implied the inevitability of a re- 
synthesis in thinking about the two when 
she wrote, “When medicine has apprehended 
the psychosomatic problem and assimilated 
it, the adjective will be obsolete: all medicine 
will be psychosomatic? (1, p. xx). 

A question about the optimum utilization 
of the obtained data deserves attention. 
Might not global clinical evaluations of such 
phenomena as moods, identifications, preoc- 
cupations, and so forth, lead to different or 
at least more comprehensive conclusions than 
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did the disparate, atomistic measures used in 
this study? An experimental design requiring 
a number of experienced psychological clini- 
cians to rate certain selected crucial variables 
on the basis of all the material in each sub- 
ject’s complete protocol of responses might 
make fuller use of the data. Such an alterna- 
tive approach, which is being planned, might 
afford a more convincing and thoroughgoing 
examination of the psychosomatic theories: 
In any event, it is clear from the foregoing 
findings and discussion that all major PSY 
chosomatic formulations need to be subjecte? 
to rigorous and searching analysis by 4 ya 
riety of techniques. 


Summary `’ 


To investigate certain hypotheses abou 
psychosomatic disease, experimental group 
of 20 asthmatic women and 20 women Wi” 
histories of ulcerative colitis and a nonn 
chosomatic control group of 20 women be! 
treated for malignant tumors, all petna si 
and 46 years of age and screened to © aa 
nate patients with multiple diseases, va 
given a test battery including the Ben i 
Gestalt, figure drawings, Rorschach, word 
sociations, and ten TAT cards. ence 

Bender-Gestalt scores gave no evidea 
that psychosomatic patients differ from oaa 
sick people in psychiatric status. TAT m ii 
scores gave no indication that psychosom 
patients are more subject to dysphoria t í 
are other physically ill persons. Rorschtt 
records revealed no significant evidence t 
psychosomatic patients are more likely Ms 
(a) give coarctated records, (b) give PE 
human movement responses, (¢) obtain ee 
weighted color sums, (d) produce static H 
man movement responses, or (e) produc? 
bony anatomy responses than are other: 
physically as ill as they are. Rorscha a 
movement responses did not reveal sig?! 
cant tendencies for asthmatics to projee 
passivity and dependency needs or for coliti 
patients to project strivings and aggressive 
drives in their fantasy productions. No ev 
dence was derived from word associations 0" 
Rorschach content to indicate that asthmatics 
are inordinately concerned with oral satisfac 
tions and deprivations or that colitis suffer- 
ers are inordinately preoccupied with excre- 
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tory functions and their indirect, symbolic 
counterparts. Neither the sex sequence of 
the two human figure drawings nor their rela- 
tive size offered any evidence of differences 
in the psychosexual identifications of women 
with asthma and women with ulcerative co- 
litis. The consistently negative trend of the 
findings and implications for theory and re- 
Search were discussed. 
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Parental Figures in Sentence Completion Test, 
in TAT, and in Therapeutic Interviews 


Mortimer M. Meyer and Ruth S. Tolman 
Mental Hygiene Clinic, VA Regional Office, Los Angeles 


A follow-up study to that reported in 
“Correspondence Between Attitudes and Im- 
ages of Parental Figures in TAT Stories and 
in Therapeutic Interviews” (1) was carried 
out with the Forer Sentence Completion Test. 

Twenty of the 50 patients used in the TAT 
study had taken the Sentence Completion 
Test. The 11 items (9, 16, 33, 35, 60, 70, 76, 
88, 94, 96, 99) referring to “mother” and 
“father” were examined, and parental atti- 
tudes and images discovered there were indi- 
cated on the same check sheets used in the 
study of the TAT and of therapeutic inter- 
views. 

Analysis of the data by the same method 
gave the following results: 

1. When the Sentence Completion Test and 
the TAT were compared in regard to fathers’ 
attitudes, six of the 20 had one item in com- 
mon and one had two in common. Of the 
seven records, four could be interpreted as 
challenging the null hypothesis at a level of 
confidence between 1 and 10 per cent. 

2. When the Sentence Completion Test and 
therapeutic interviews were compared in re- 
gard to fathers’ attitudes, only five had any 
item in common and none more than one. Of 
these five only three could be interpreted as 
challenging the null hypothesis at a level of 
confidence between 5 and 10 per cent, 

3. When the Sentence Completion Test and 
the TAT were compared in regard to moth- 


ers’ attitudes, only two had any item m on 
mon, neither more than one, and neit 
could be interpreted as significant. d 
4. When the Sentence Completion Test E 
therapy sessions were compared in regard k 
mothers’ attitudes, five had one item m co 
mon, none more than one, and only one m 
lenged the null hypothesis at a level of co 
fidence between 5 and 10 per cent. a 
5. In regard to fathers’ images, comp? 
son of the Sentence Completion Test with i 
TAT and with therapy sessions shows c a 
one item in common in each comparis© 
Neither is significant. ari- 
6. In regard to mothers’ images, COMP the 
son of the Sentence Completion Test with Er 
TAT and with therapy sessions shows ae 
items in common in each comparison. 
of these is significant. tti- 
These results suggest that the kinds of a > 
tudes and images of parents which are giv 
in the Sentence Completion Test furnish 
basis of prediction of those found in eith 
TAT stories or in therapy sessions. 
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Some Standardized Scales for Disorganization 
in Schizophrenic Thinking’ 
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oa descriptive psychopathology we often 
a by illustration. Thus, in speaking of 
De ag in schizophrenic thinking, we 
a a t illustrate it by quoting at random sev- 
Ha ee of schizophrenic responses to 
fear lary items on a standard vocabulary 
ts Such clinical materials are rarely pre- 
nted in the order of the severity of pa- 
ology exhibited, but usually are put before 
s Student in random, unorganized fashion. 
if i be more meaningful, pedagogically, 
Side T could be presented in some kind of 
oti erly scale. The difficulty of presenting 
nical material in this fashion is that we 
ee no “standardized” materials from which 
ene Pathological material is rarely or- 
ape scaled in this fashion, perhaps, be- 
ling of the assumed unreliability of the 
o ical judgments which must be the basis 
Y such a scaling approach. 

n a previous study (1) in which 22 ex- 
Perienceq clinical psychologists rated, on an 
a “Point scale for disorganization of think- 

S, Standard vocabulary item responses ma de 
Y schizophrenic patients, we found indica 
“ns that there might be sufficient ig? 
ae among clinicians on such items for m 3 
§ purposes. We, therefore, decided to y 
Onstructing such scales, limiting ourselves to 
Pathology as manifested on verbal test Te 
S ilability of 
Ponses because of the ready availabili 

€ material and the ease with which it can 


t ` This study is part of a larger project Pena 
der ONR contract 7 onr—450(11) with Nor ee 
tha University. The opinions expressed, however, art 
those Of the individual authors and do not rep 
© opinions or policy of the Naval service. 
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be reproduced without photographic or pho- 
nographic recording. 
Procedure 

In the previous study (1), 222 schizo- 
phrenic responses to Wechsler-Bellevue and 
Terman-Binet Vocabulary items, judged by 
three trained clinicians as covering all pos- 
sible values of confusion in thinking in such 
responses, were rated by 22 clinical psycholo- 
gists of at least four years’ professional ex- 
perience using an 11-point scale for degree of 
disorganization in thinking. On the basis of 
the means and standard deviations of the 
raters’ judgments for these items, we selected 
50 of them for the present study. These items 
were evenly distributed over the 11-point 
scale used and seemed to represent an ade- 
quate sampling of the original universe of 
items. 

In an attempt to extend the range of our 
materials we also selected 50 responses to 
Comprehension items on the Wechsler-Belle- 
vue Intelligence Scale. These were chosen 
from the same original test protocols from 
which the vocabulary items were drawn, and 
were judged as being representative of the 
complete range of pathology exhibited. Other 
types of test materials such as Information 
and Similarities were considered for use but 
were discarded after inspection of a large 
number of such responses revealed that they ` 
did not offer a suitable range of pathology for 
the construction of scales with more than a 
minimum of scale points. 

For the present study, it was felt more de- 
sirable to have the judges rate on a 7- rather 
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than an 11-point scale. Furthermore, the in- 
structions for the subjects in the present 
study were modified, as the previously used 
instructions were felt to be too vague. Indi- 
cations from the data and discussions with 
the subjects of our first study indicated that 
other criteria than mere severity of pathology 
were being used. Prognosis, therapeutic indi- 
cations, etc. were all being used, confounding 
the variable under study and lowering the 
reliability of the judgments. We, therefore, 
wrote very careful, explicit instructions, de- 
fining the task requested of the judges. This 
point is of considerable importance because 
of the reliability of the results of the present 
study, which is much higher than that previ- 
ously discovered in our own work (1, 4) and 
that of others (2, 6). The instructions fol- 
low: 


We are going to present you with a number of 
schizophrenic test responses to items taken from the 
Wechsler-Bellevue and Terman intelligence scales. 
One of the ways in which the pathology of schizo- 
phrenia may express itself is through disordered 
thinking which results in atypical, deviant, or “ab- 
normal” responses to the items on such a test. The 
qualitative interpretation by the clinician of such 
test responses is one of the bases upon which he may 
base a clinical or diagnostic interpretation. All of 
these responses were given by schizophrenics. None 
of the cases were complicated by mental deficiency 
or known organic conditions. The extent of the pa- 
thology exhibited however is not uniform. In some 
of the responses it is minimal and in others it is 
extreme. 

We are going to ask you to rate these responses on 
a 7-point scale according to the severity of the pa- 
thology exhibited in the response, with the low end 
of the scale representing minimal pathology and the 
high end of the scale representing maximal pa- 
thology. In making these ratings we are asking you 
to concentrate upon the severity of the pathology 
exhibited in the response itself. We are not inter- 
ested in such things as prognosis, chronicity, thera- 
peutic indications, etc. In essence, what we are ask- 
ing you to do is to judge how “schizophrenic” each 
response is. 

Our basic assumption is that the nature of such 
responses is one of the dimensions upon which a 
diagnosis of schizophrenia is made. We are assum- 
ing that some, kind of a continuum exists and that 
these items could be placed upon it, ie. the pa- 
thology exhibited in some of these responses may be 
such that in and of itself it would not lead you 

to think that the persons responding were schizo- 
phrenic. Others of them might cause you to suspect 
schizophrenia. In still others, the pathology ex- 
hibited may be so extreme as to make you reason- 
ably sure that the patient is schizophrenic. We re- 
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alize that no actual diagnosis would ever be made 
on the basis of such responses alone. In this sense 
our situation might be called somewhat artificial. We 
are not asking you to make a diagnosis of schizo- 
phrenia on a patient, however. We are merely ask- 
ing you to rate how schizophrenic each of these re- 
sponses is. 

Pwe are doing this because we wish to see whether 
or not there will be sufficient agreement among ia 
nicians so that we may establish scales represen 2p 
the typical responses of schizophrenics. The obvior 
analogy would be with a handwriting scale oF “ 
colorimeter in chemistry. 

Our hope is that even if such scales would not be 
applicable in the diagnostic situation as an al 
evaluating the nature of actual test responses ia 
making a clinical interpretation of actual tes tee 
sults, they nevertheless would be very helpftt 5 
teaching purposes. Thus, in introducing studen J 
the pathology exhibited in schizophrenic fies 
instead of introducing random illustrations oid þe 
culiar responses given by schizophrenics, it wou . 


* eries 
of real value to present them with an orderly 5! 


ontinuu™ 


or 


of test responses, scaled on a 7-point © nt of 
based on the empirically ascertained agreem¢) fnd 
a group of trained clinicians. Our goal is Pe to 
whether or not such scales are possible and, i ec 
construct them. Your judgments on this expere for 
will be the basis for our work. We thank YOU sith 
your cooperation and hope that you will agree Jong 
us that such work is valuable in attaining the 

range goals of our mutual profession. “0 


The 50 Vocabulary responses and ei. 
Comprehension responses were then prese the 
to 16 clinical psychologists working ph D. 
Chicago area. Each one possessed the a 
in clinical psychology and a minimum 0. 
years on-the-job clinical experience. Th vE 
were mimeographed and presented so that a 
cabulary items were rated first and Comp". 
hension items second, with the same sheet 
instructions serving for both. Due to the 1? $ 
tively small N, counterbalancing the order 
presentation was not attempted. ur 

In order to check the reliability of °° 
judges and materials, the task was repea ily 
three months later. The subjects were initia a 
unaware of our intent to request a retest. “a 
group repeat reliability was .97 for Vocab A 
lary and .96 for Comprehension, using fie 
Pearson r. The individual test-retest © 
cients using the Pearson r for the individu 
judges ranged from .65 to .92 for Vocabulary 
and from .68 to .90 for Comprehension. d 
agreement among the clinicians was measure 
by correlating each individual’s judgments 0” 
each group of 50 items with the average of 
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the group of judges, using a Pearson r. These 


ranged from .7. 


from 


3 to .92 for Vocabulary and 


-64 to .88 for Comprehension on the 
first Presentation, and from .69 to .92 for Vo- 
cuty and from .66 to .86 for Compre- 
ae on the repeat performance. These 
eliabilities were considered sufficiently high 


Table 1 


Vocabulary Scale 


Response Mean SD 
gsuble—To takea chance, a risk 1.00 0.00 
eclude—To go away and be 
ane to seclude oneself 1.50 0.63 
onkey—A type of four-legged 
animal 1.50 0.52 
Gown—Garment you wear for 
lounging 1.75 0.93 
rewd—Careful in a sneaky, 
clever way 2.19 0.75 
ail—A bit of metal used to ” 
Pound on 2.37 0.81 
Plural—y 2.94 0.93 
eans plus another . 
Join—Has todo with organization 2.62 0.96 
eculiarity—Action one doesn’t 115 
usually engage in 3.00 1. 
Milkso; ic li 
P—A sympathetic listener, 
but lacking in understanding In ta 
nE onage—Crooked, not truthful 41 $ 
eclude—To put somewhere in 
the dark 5 381 11 
Armory—Combined form of some 
0.77 
Sort of organization 4.94 
Juggler—Acts in front of a person, 5.00 082 
Ba sheets himself as a Jgs h 
“Spionage—A type of sinful dev- 89 
ilment 544 0 
Nail—Metal I guess, let’s say & 
Metal which is made acena 
EN for purpose of good an 5.75 0.93 
use 
Armory—Part of army subject tO < o4 0.85 
call without banner He 
iamond—A piece of glass ma 644 0.63 
from roses 
il f 
Erehion nTa sleep on & pillow% 675 0.45 
d’s shee idi 
Fable—Trade good sheeP to hide 6.81 0.40 
in the beginning subject 
Guillotine—Part of law Tin t 
Ste those without CBI f 5 60 062 


only to those W! 


i 


Table 2 


Comprehension Scale 
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Scale 
Point 


Response 


Mean 


1 


Envelope—Deposit it in the mail 
box z 

Taxes—Taxes are necessary to 
support the government 


Land in the city—Because they 
got more accommodations in the 
city than in the country 

Envelope—Best thing is to bring 
it to post office 


Envelope—Pass it by or mail it 
Theater—Turn in an alarm so that 
everyone wouldn’t get burned 


up 


Marriage—Proof and identifica- 
tion so you wouldn’t get some- 
one else’s wife 

Shoes—Probably just tradition, 
Dutch use wood 


Laws—It is reasonable for a group 
of people to come to some agree- 
ment and acceptance of a com- 
mon good and to aid what has 
proven to be the best for the 
many; that is they are made to 
prevent illegal activities 

Shoes—Because Jeather has un- 
doubtedly proved to be the most 
durable of all that which has 
been utilized for the preserva- 
tion of the feet and to continue 
the comfort of those, that is the 
people who have chosen to wear 


shoes 


Marriage—For ownership you 
might say and to take care of 
each other according to health 

Marriage—Some people get mar- 
ried in church and some people 
get married outside of church 


Forest—I’m not good at telling 
directions. Just walk uphill 
and when you get to the top it 
is easier going down 

Marriage—For scientific purposes 
and for the identification of sib- 
lings, siblings of the association 
of the parents 


1.06 


1.06 


2.00 


2.00 


2.87 


3.00 


4.50 
3.69 


4.87 


5.06 


5.87 


5.69 


6.31 


6.31 


1.03 
1.25 


0.96 


1.12 


0.96 


1.09 


0.71 


1.01 
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to justify construction of rough scales from 
the obtained data. 

The items for the scales were selected by 
choosing those responses whose means were 
closest to the desired scale point and whose 
standard deviations were the lowest available. 
Differences between the mean rating for each 
item on the test-retest were tested using Stu- 
dent’s ¢ for correlated data (3, p. 277), and 
for variances using the formula given by Mc- 
Hugh (5) for comparing two correlated sam- 
ple variances. The few items which showed 
significant differences were discarded. Three 
scales for Vocabulary and two for Compre- 
hension were selected, based on the above- 
mentioned criteria for item selection. The rat- 
ings on the first testing are used as it is felt 
they are more representative of the “true” 
value, ruling out the effects of practice or 
memory, negligible though they were. These 
are presented in Table 1 where all three Vo- 
cabulary items for each scale point are listed 
together, as are the two items at each scale 
point for Comprehension in Table 2. 


Discussion 


It will be noticed that in the case of Com- 
prehension there is some indication of a short- 
ening of the scale at the upper extreme. 
Apparently, our severe Comprehension items 
were regarded as somewhat less extreme than 
were the Vocabulary items. The reasons for 
this are unknown. Our figures on the reli- 
ability of clinicians’ judgments with this type 
of material are higher than those we reported 
previously (4). This may be attributable to 
sampling, but we feel that the modification 
and clarification of our instructions may be 
a prime factor influencing this change. As one 
of us has said previously, “When dealing with 
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experts in a judgmental situation, the task 
should be well defined and the criteria set 
forth clearly. Otherwise the riches of knowl- 
edge may yield confusion rather than clarity 
(1, p. 274). 

The scales here presented are admittedly 
rough. No attention has been paid to such 
theoretical problems as equality of interval, 
etc., and a cross validation of the data 1S 
necessary. In their present stage, however, We 
feel they are valuable as pedagogical aid 
Future development of such scales mg 
make it possible to introduce quantitative 
scoring for the qualitative cues that clinicians 
presently derive from test materials. This 
type of material might also be used as @ 
“test” of clinical ability if the materials Hi 
given to clinicians, and they were asked he 
rate them. Individual agreement with i 
group consensus then might be a measure a 
clinical aptitude, or at least of an appro# 
to accepted current clinical interpretation. 


Received October 19, 1954. 
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in n recent years, there has been an increas- 

S Interest on the part of psychologists in 
nes of projective techniques for prediction 
seq). 2¥ior_which has important social con- 
| ences, Such study not only has the value 
inter tributing crucial data necessary for an 
boas ed theory of behavior in general, and 
Se techniques in particular, but also 
fice Psychology to fulfill its professional 
and fet of aiding the culture in maintaining 
bers elping its emotionally disturbed mem- 


Ba area of behavior with important social 
"sequences which was chosen for the cur- 
a Study was the great number of tbere 
tor; Pétients who leave hospitals and san 
ref ‘ums against medical advice (subsequen ly 
W *tred to as AMA behavior). Since the ove 
qrelming majority of these patients have 
ma Communicable disease, the ner cor 
quences of their leaving the hospital 4 
sutitely more serious than would be the re- 
psor similar actions on the part of nm 
TOtics or persons suffering from none re. 
Physical diseases. These latter individuals na 
sent difficulties to themselves po Ei 
Pst to their immediate amily e 
To hie Patentit commu- 
lal source of infection to ia ese hin. 


Nity as well as an obvious 
Jogist, VA Center, Mar- 
Formerly Clinical Psycholog 


tinsburg, West Virginia. 


self in having interrupted or terminated his 
treatment. 


A review of the literature on tuberculosis reveals 
several important facts about this problem of AMA 
behavior. First, it is a world-wide problem and not 
merely limited to certain hospitals with inadequate 
facilities. Second, the consensus in the literature is 
that such action stems from pressures from three 
sources: (a) the person’s own needs, (b) the influ- 
ence of friends and relatives outside the hospital, and 
(c) pressures put upon the person by the hospital 
environment. Third, while there has been much 
speculation concerning personality in the tubercu- 
lous, including efforts to define a tuberculous person- 
ality or character type, there has been little in the 
way of controlled experimental investigation about 
any phase of the psychological concomitants of ty- 
berculosis. Only Gurel and Jennings (5), to our 
knowledge, have attempted any integration of theory 
with empirical investigation of this problem. Essen- 
tially the theoretical basis of their study was one of 
a temporal relationship between the operation of re- 
ward and punishment and the acquisition and reten- 
tion of behavior (9). Thus, in terms of tuberculous 
patients, those who exhibit AMA behavior demon- 
strate an inability to inhibit impulsive behavior in 
order to derive long-term satisfaction, while patients 


ess determining patients’ behavior is the general hy- 
pothesis, at the level of behavior theory, on which 
the present study is based. s 


projective techniques uti- 
were the Rorschach test, 


, The particular 
lized in this study 
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the Thematic Apperception Test, and House- 
Tree-Person Test. The particular hypotheses 
tested experimentally will be described in the 
following sections. It suffices here to point out 
that these three tests constitute samples of 
projective techniques which vary both in 
terms of instructions and degree of structure 
of overt stimulus material presented to the 
subject. 


Subjects and Method 


Since January of 1953 a group psychologi- 
cal testing program has been carried out for 
all admissions to the TB Service as soon as 
they have been cleared by the ward physicians 
as physically able to take the tests. The ma- 
jor purpose of the testing program is to pro- 
vide significant information to the physicians 
in regard to the patients’ attitudes toward 
their illness, hospitalization, and treatment, 
and to identify emotional problems which 
could interfere with hospital adjustment or 
response to treatment. However, the test pro- 
tocols are also available for research purposes. 
As of January, 1954, approximately 350 pa- 
tients had been tested. Of this group, 63 had 
received MHB discharges and 95 had re- 
ceived AMA discharges. 

From these two samples of discharged pa- 
tients, all cases were chosen who had been 
given any one of the three tests selected for 
analysis. Inasmuch as the particular battery 
of psychological tests used for the admission 
testing program varied according to the pref- 
erences of the staff psychologist assigned to 
the TB Service, the populations for study of 
the three tests overlap but are not identical. 


Description of the specific subjects used for 
each test is included in later sections. 


Analysis of the Tests 
Rorschach 


The hypotheses tested in this study by 
means of the Rorschach were derived from a 
series of deductions based on the writers’ gen- 
eral hypothesis at the level of behavior, their 
assumptions concerning the projective tech- 
nique situation, and the generally accepted 
clinical interpretations of scoring categories 
of the Rorschach responses. 

Since the basic theory being tested was that 
AMA patients are significantly less able to 
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inhibit impulsive behavior in order to obtain 
long-term satisfaction than are MHB pa- 
tients, only the determinant categories of the 
Rorschach were chosen for analysis. Accord- 
ing to Rorschach literature (6), the deter- 
minants reflect the emotional aspects of Pet 
sonality and serve as a principal basis for 
predicting overt behavior. 

The following hypotheses in regard to the 
determinants were formulated: 


a. AMA patients will be higher than MHB Pi 
tients in: F —, F — %, CF, C, =C, FM. acne 
b. MHB patients will be higher than AMA P 
tients in: F, F%, FC, M, C’, c, k, K. ceed 

c. Within the AMA group, CF + C should s uld 
FC, FM + m should exceed M, and FM +m sho 
exceed c+ C’. d CF 

d. Within the MHB group FC should a ould 
+C, M should exceed FM +m, and ctOS 
exceed FM + m. 


Subjects. Rorschachs were selected for E 
male AMA patients and 46 male MHB Ki 
tients so that the two groups were compara 
for age, race, marital status, education, ©" 
gree of disease, and type of treatment a 
scribed. Respective mean ages were 39.65 2 ie 
39.67. All tests for these 92 patients, dee 
fied only by a number to avoid possible i 4 
were rescored by one of the authors to ma 
tain consistency. ex 

Data analysis. The first score to be ae 
amined was the mean number of respor 
for each group (R). Had there occurre 
significant difference between the number sl 
responses for the two groups, raw determin et 
scores could not have been used and the ef za 
of R on each of the several determinant ee 
gories would have had to be controlled $ 
tistically. However, mean R for the AMA ee 
MHB groups was 14.5 and 14.3, respective y: 
and the chances were 99 out of 100 that suc 
a difference would arise by chance alone. st 

Two of the determinants, C and K, did n° 
occur sufficiently often for the purposes W 
testing the empirical hypotheses by means i 
an analysis of differences between the AM 
and MHB groups. Such results are in lin 
with previous Rorschach experience. 

The remainder of the determinants 20° 
lyzed produced sufficient data for the PUT 
poses of testing the hypotheses formulated: 
Since the empirical hypotheses were stated i? 
terms of a specific direction of the results, # 
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Table 1 


Comparison of AMA and MHB Groups on 
Rorschach Determinants 


(N = 92) 
Mean SD 
Determi- 
nant AMA MHB AMA MHB CR $ 
AMA predicted 
greater 
a 19 18 24 24 O02 45 
Er% 33.0 25.0 25.0 18.0 18 .04* 
S LS i4 24. of sf IG 
e 25 21 30:30 07 25 
uM 15 20 21 28 10 -16 
u 7 o7 it 13 = ~ 
Predicted 
Breater 


100 Such differences could occur by chance 10 or less times in 
Nstances, 


one-tailed z test was used to determine prob- 
llities (4). The results are listed in Table 1 
and Table 2, al hy- 
n making a series of tests of empirical A 
Potheses one can always expect that a cer 
tain Number of significant differences i ch 
7 'S€ due to chance relationships in SE rA 
herefore, a chi-square test was ma fs re- 
Ween the observed number of significan 10) 
Sults and near significant results (P< - 


and the expected number oF an Psi 
e ET : 
miter tests were Peale differences 


umber of statistically re ight 
Would be expected by chance alone ee 
esnificant results were actually o n the 
square test of the difference De yields a 
Served and expected frequent Sie the 
Value of 51.2, With 1 degree of fre 
Chi-square value must be grea be 
eee pe eee nd the 01 level of P 
ability, it is conc: ; differ- 
Served Rna statistically reliable 
ĉnces could not have develop 
alone, icted Ror- 
Conclusions. One-half of oe ee be in- 
Schach scores and ratios, i behavior, were 
icative of ability to contr 
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found to differentiate between the two groups 
at better than chance level. These findings 
would support the general hypotheses postu- 
lated; however, none of the obtained differ- 
ences for the individual Rorschach determi- 
nant categories are significant at a level which 
would yield accurate prediction for the indi- 


vidual case. 


Thematic Apperception Test 

The second approach to the problem of the 
prediction of AMA behavior of tuberculous 
patients was the utilization of a projective 
technique designed primarily to elicit under- 
lying personality dynamics. It was hypothe- 
sized that content analysis of the Thematic 
Apperception Test would reveal certain needs 
operating which were common to the ea 
group but absent in MHB patients. Shoul 
this be true, an explanation of AMA behavior 
could be made, which in turn would allow for 
prediction and for institution of preventive 
P Conaderation of the nature of the disease 
and of treatment methods suggests that two 
important problem areas confronting the TB 
patient are those of aggression and depend- 
ence. The patients who are able to remain 
hospitalized for lengthy periods of time and 
undergo painful treatment may display strong 
needs for punishment and for submission and 
dependence. The AMA patients, on the other 
hand, seem to show an inability to accept 
either the loss of autonomy or the enforced 
dependence necessary for treatment, and by 
their antisocial behavior seem to reflect needs 


Table 2 


Comparison of AMA and MHB Groups on 
Rorschach Ratios 


(Predicted AMA group should exceed MHB group 
on each.) 


Percentage of 
subjects 
Ratio AMA MHB CR p 
FM+m>c+C' 70 57 1.3 .10* 
FM+m>M 67 52 uS .07* 
=C>M 70 50 2.0 .03* 
CF+C>FC 57 39 1.8 .04* 


* Such differences could occur by chance 10 or less times in 
100 instances. 
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to direct aggression outwardly. It was there- 
fore hypothesized that the AMA group would 
score high on needs for externalized ag- 
gression, dominance, and independence. The 
MHB group was expected to display the 
converse. 

One further analysis of the TAT records 
appeared appropriate for prediction of AMA 
behavior. It was hypothesized that patients 
who leave AMA also are more prone to act 
on their needs than are those patients who re- 
main for the full course of treatment. Action 
was scored from the TAT stories in terms of 
whether the need expressed took the form of 
direct action or whether the need was ex- 
pressed only as fantasy, contemplation, or as 
a possibility in the future. The first instance, 
where the need found expression in action, 
was characterized as the motor level; when 
the particular behavior was only contemplated 
or fantasied it was designated as the premotor 
level. 

Subjects. Twenty white male veterans who 
had been given TAT’s as part of the admis- 
sion group testing program were selected. 
From their history 10 were identified as AMA 
and 10 as MHB. None of the AMA patients 
had been able to remain in the hospital for 
more than 4 months, the mean length of hos- 
pitalization being 2.73 months. All of the 
MHB patients, on the other hand, had been 
in the hospital for at least a year, the mean 
length of hospitalization as of June, 1954, 
being 16.4 months. The mean age of the 
AMA group was 35.1 yrs.; that of the MHB’s, 
33.4 yrs. The two groups were also equated 
as to economic level, pension status, marital 
status, stage of disease, and type of treat- 
ment. 

Data analysis. Four cards of the TAT had 
been regularly given to each of the twenty 
subjects. These were numbers 1, 4, 6BM, and 

7BM. The TAT records were scored by the 
need-press system devised by Aron (2). A 
ratio was computed for each patient by total- 
ing the number of needs for external aggres- 
sion, dominance, and independence (EDI) 
and relating this to the total number of needs 
for inward aggression, submission, and de- 
pendence (ISD). The data were placed in a 
fourfold table and analyzed by the chi-square 
technique. 
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Table 3 
Comparison of AMA and MHB Groups on the TAT 
(N = 20) 
Condition F. $ 
EDI vs. ISD with AMA and MHB 30 
combined 0.80 30 
AMA vs. MHB on EDI and ISD 0.83 
Motor vs. Premotor with AMA and 50 
MHB combined 0.20 


AMA vs. MHB on Motor and Pre- 0.21 50 


motor Responses 


Each need was scored also on the mote 
premotor dichotomy. These data were pera 
in a fourfold table and subjected to ê c 
square analysis. 

Tit was determiieð first that the occurrere 
of EDI responses does not differ significan e 
from the number of ISD responses wit e 
samples combined. Should one of the varia if 
predominate in all the TB subjects, it ie A 
be more difficult to discover a significant A 
ference between the subgroups. Howeve", 
can be seen in the first result of Table ~? 
neither EDI nor ISD responses are pt 
cantly more plentiful when the two sropils 
are combined. Chi square is 0.80 and this 


The second result in Table 3 relates ae 
directly to the hypothesis that AMA patie 
display strong needs for external ag: 
dominance, and independence, while 
patients have greater needs for intern fter 
gression, submission, and dependence. A sD 
characterizing each subject as EDI or idu- 
and comparing the number of such indivi’. 
als in each group, we find that chi square al 
only 0.83. This does not reach the 30 le m 
of significance and therefore fails to confit 
our major hypothesis concerning the dynam" ve 
operating in tuberculous patients who lea 
the hospital against medical advice. as 

Our last analysis concerned the level of ¥ 
sponse, i.e., whether the need was express t 
as definitely carried out in motor behav}0"' 
or whether it was presented in the form o: 
wish, fantasy, or intention and therefore w 
premotor. The third result in Table 3 sho é 
that the number of needs scored as at th 
motor level did not differ significantly fro” 
the number of needs scored at the premoto™ 


g- 


i 


ve 


A n a. 
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level with the AMA and MHB samples com- 
bined. Chi square is .20 which is not signifi- 
cant at the .50 level of probability. Once 
again, if significant differences do exist be- 
tween the groups, they should not be ob- 
Scured. 

However, the AMA and MHB groups are 
not differentiated by the level of response as 
can be seen in the final result of Table 3. 
Chi square is only .20, and, therefore, there 
are 50 chances out of a hundred that the dif- 
ference is a chance one alone. From this sam- 
ple then, a preponderance of responses at the 
motor level does not of itself indicate a pro- 
gd for AMA behavior, since responses at 

Is level are fairly evenly divided between 
oth groups. 

Conclusions. The failure of the TAT to ef- 
€ctively discriminate between the AMA and 
ri patients can be viewed from several 
3 pects. Specifically, it is quite possible that 
‘aad Particular hypotheses concerning the dy- 
R mics of tuberculous patients are in error. 
ana thermore, it can be questioned whether 
By definite constellations of needs or dynam- 

S are operating in tuberculous patients in 
peneral or AMA patients in particular. It has 
Sng been an axiom of the psychodynamic ap- 
Proach that the same bit of behavior often re- 

ects different needs in different individuals 
Or even distinct needs in the same person at 


Separate ti ; in relation 
e times. ld this be so 
mes. Shou se of tests re- 


to the AMA problem, the T 
piling ad a eeds and content of ee 
a Strivings becomes suspect aS an ade 
ae tool for the prediction of this particu 

1t of behavior. i 
b ne exception to the last statement miet 
€ Pointed out. As yet little is known am 
“ontent-type tests which present te 
With a stimulus which symbolizes i a P A 
ticular situation in which the predi, a 
Overt behavior is to be made- Wha 


f ification of 
Consi hors is & modi 2 
t sidered by the aut ict the particular 


e TAT which would depict cing the TB 
Problem areas and situations cne Jet 
Patient. Perhaps such # eee rare ger- 
Needs and unconscious atita A a pedicted 
Mane to the overt bebavio’ g oe covered. 
and some communality ooh aits further in- 

his particular problem aw 
Vestigation. 
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House-Tree-Person Test 


Inclusion of a drawing test in the battery 
of techniques selected for analysis was based 
on the hypothesis that nonverbal tests tend 
to yield data less subject to consciously con- 
trolled evasion and censorship and thus pro- 
vide a more efficient basis for prediction of 
impulsive, overt behavior (11). The HTP 
test was chosen since the house and the per- 
son constitute stimuli approximating two of 
the focal elements in the problem behavior 
being studied, namely institutional versus 
home living, and the patient’s perception of 
his own goals and needs. 

Contrary to the usual assumptions concern- 
ing the house drawing as reflecting attitudes 
toward home and family, the authors assumed 
that the house drawn by the patient would 
symbolize aspects of his concept of and atti- 
tudes toward his important living space (3). 
The following specific hypothesis was made: 
AMA and MHB patients will differ signifi- 
cantly in the treatment of all parts of the 
House drawing which pertain to an interac- 
tion of outside and inside. The following 13 
test characteristics were thus selected for dif- 


ferential analysis: 


. door placement 

window details 

details on door 

number of windows 

chimney treatment 

. inclusion of walk 

inclusion of steps 

inclusion of fence 

_ inclusion of road 

10. inclusion of garage 

_ inclusion of shrubbery and trees 

. direction of house facing (e.g. differential place- 
ment of small side) 

13. ground line drawn 

Three aspects of the person drawing were chosen 
for analysis: direction the person was facing, type 
of neck treatment, and presence or absence of hands. 
Underlying the use of these three variables were the 
current theories of drawing interpretation: (a) fac- 
ing to the right hand side of the paper represents 
externalization of action; (b) the neck depicts the 
type of controls over body impulses; (c) treatment 
of hands depicts aspects of interpersonal relation- 
ships (8, 11). 

Subjects. Thirty male MHB patients and 
50 male AMA patients were selected. Mean 
ages for the two groups were 36.2 and 34.7, 
respectively, with ranges of 18-65 and 21-63. 


GUNDUA Nm 


180 


Approximately 85% of each group were white 
(83% and 86%, respectively); the remainder 
were Negro. Total length of hospitalization 
for the MHB group ranged from 2 to 47 
months, with a mean of 11.0 months; for the 
AMA group the mean was 3.8 months, with 
a range of 1 to 9 months. The two groups 
were equated for education, occupational 
status, marital status, degree of disease, and 
type of treatment. 

Data analysis. Incidence of occurrence was 
tabulated for each of the 16 test variables 
selected and the differences in percentages 
computed. Results are given in Table 4. 

Of the 16 variables tabulated, two did not 
occur sufficiently frequently in either group 
to permit further analysis. Of the remaining 
14, seven yielded differences between the two 
that could be expected to occur by chance 


Table 4 
Comparison of AMA and MHB Group on the HTP 
(N = 80) 
Percentage of 
subjects 
Item AMA MHB CR Pp 
House 
Door on left side of 
page only 6 27 2.3 .02* 
Door details, 2 or 
more present 24 30 0.6 55 
Window detail 
drawn as + 62 23 3.9 .0001* 
No. of windows, 
4 or more 32 
Smoke from chim- = ze ʻo 
ney 26 0 : Ea 
Walk present 20 10 ia ores 
Steps drawn 18 27 1.0 .32 
Road indicated 12 0 2.4 02* 
Shrubbery and/or A 
trees drawn 2 10 2.0 .06 
Small side of house 
on right side of 
page 44 20 2.4 .02* 
Ground line drawn 22 3 2.7 .01* 
Person 
Head facing to right 
of page 20 7 1.6 AL 
Neck either omitted 
or drawn wider 
than long 50 37 1.2 -23 
Hands omitted 44 23 21 .02* 


* Such differences could be expected to occur by chance less 
often than three times in 100. 
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less often than five times in 100. The expected 
frequency of results below .05 by chance 
alone would be 0.8. A chi-square test yields 
a value of 40.61, which is well beyond the 
.01 level of 6.63 for one degree of freedom. 

Conclusions. The general hypothesis was 
confirmed that a nonverbal test which pre- 
sented stimuli to the subjects, certain ele- 
ments of which were directly related to a 
problem area of behavior to be predicte, 
would yield differences between „the g 
groups sufficiently reliable to permit predic 
tion for the individual case. 


Application of Results to a Second 
Sample of Patients 


Patients admitted for the first time to the 
hospital and seen for psychological bal, 
during the period of January through Mar i 
1954, constitute a group available for 4 pan 
tial approach to cross validation of the in 3 
ings. Test reports written by the aut n 
assigned to the TB Service at that time E 
cluded a specific prediction of whether the i 
tient was a potential AMA risk. Since aes 
report also included a description of the 14° 
tors involved for the individual and the “a 
plications for treatment, it is impossible A 
evaluate the influence of the report, the Pa 
diction, and the suggestions upon the su ist 
quent actions of the patient. The psycholog È 
responsible for the predictions had koon i 
edge of the findings from the statistical ana z 
sis of the three tests but did not use any he 
of index or quantified approach. The analys 
of the accuracy of the predictions is show 
in Table 5. b 

Since all the patients had been in the oS 
pital less than six months, these data are Ae 
final figures. It is interesting to note that is 
date all of the errors in prediction have beé 
in one direction, namely, patients identifi’ 
as potential AMA risks who still remain ! 
the hospital. 


General Discussion of Results 


Implications of findings for the problem of 
AMA behavior prediction. Despite the smal 
samples available for analysis, a sufficien” 
number of reliable differences in test score? 


were found to permit accurate prediction for 
individual patients. The data for one of the 


Differential Prediction from Three Projective Techniques 


Table 5 


Application of HTP Findings to First Admission 
Patients Over a Three-Month Period 


(N = 26) 
Number of 
patients 
(Prada Number of discharged 
rediction patients AMA* 
An AMA 3 
potential 16 12} 
No AMA potential 10 ot 


* 
fice of August 15, 1954, 
mbined accuracy of prediction equals 85 per cent. 


iad the drawing of a house, justified the de- 
©opment of a specific index. Use of this pre- 
ictive index with two other groups of TB 
P: atients will be reported subsequently. 
While the findings support the general hy- 
P Othesis that the patients who leave the hos- 
Fatal AMA show less control over their be- 
pro than do patients who stay, there was 
na confirmation of specific differential dy- 
ET Ics or personality characteristics between 
wh; two groups. The one concrete conclusion 
ich may be drawn is that, regardless of the 
Problems and motivations of the individual 
Patient, those cases who leave against advice 
Project their perception of ease of access and 
“it into their representation of a dwelling. 
Since the study demonstrates that potential 
h Patients may be identified accurately 
Shortly after their first admission to the hos- 
Pital, the next problem is that of preventive 
treatment. The major implication of the pres- 
findings is that one important factor 1s 
€ perception of the hospital as an empty 
Nd unsatisfying place which has no bar 
Ners to prevent departure. T! hus, one area O 
Needed attitude change to prevent AMA dis- 
arge would appear to be the patients’ con” 
“eptions of the hospital itself. = ne 
Implications of results for projeti Ka 
eory. For several decades psychologica’. ie 
Stature has presented discussion of Ye be: 
aspects of the problem of prediction 7 ‘cet 
avior from projective techniques. Mu ties 
the attention has been focused on difficu ; 
m validation of the tests or verification © 


es 
Isolated hypotheses about selected test OE 
or characteristics. Within recent Mire Be 
Cteasing emphasis has been placed on 
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of projective measures in the practical area 
of evaluation of changes occurring during the 
psychotherapy process and the prediction of 
response to psychotherapy (1, 10). 

However, the absence of an integrated, 
comprehensive theoretical basis continues to 
handicap much of the clinical research with 
projective methods. Although there has been 
an increasing tendency to rely on field theory 
as an adequate frame of reference for the or- 
dering of projective behavioral data, rela- 
tively minimal use has been made of this con- 
ceptual framework in experimental studies. 
The authors have derived their basic hypothe- 
sis of the use of interaction measures for be- 
havior prediction from the basic postulate of 
field theory that behavior is a function of the 
person-situation relationship (7). Therefore, 
to predict reliably a specific behavior, the 
psychological instrument used must measure 
the interaction of the person’s needs and the 
situational stimuli. To the extent that a given 
projective test provides such measures, the 
more accurate the prediction of the external- 
ized behavior. 

In selecting the three diverse types of pro- 
jective techniques for analysis in this study, 
the authors had assumed that a differential 
level of accuracy in prediction would result. 
While all three of the tests provide measures 
of individual dynamics, the tests may be ar- 
ranged on a continuum of the amount of 
situational stimuli presented. In terms of the 
very literal description of the behavior to be 
predicted, namely, a person walking out of a 
living place, the tests could be ordered as fol- 
lows: drawing of a tree, TAT, Rorschach, 
drawing of a person, and drawing of a house. 

The findings of the present study support 
this hypothesis. Neither the tree drawings nor 
the TAT yielded any reliable differences be- 
tween the two groups of patients. The Ror- 
schach and person drawings gave reliable 
group differences but could not be used for 
clinical prediction. The house drawings were 
successful in prediction for the individual 
patient. 

The major implication of the present study 
for projective methods would appear to be a 
confirmation of the importance of analysis of 
interaction between person and situation for 

ehavioral prediction. For such an 


—— 


. 
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analysis to be possible, it is essential that the 
tests, while ambiguous, present stimuli which 
tap the specific situation or area in which the 
behavior to be predicted occurs. 


Summary 


Three projective tests were analyzed in 
terms of reliability of differentiation between 
two groups of hospitalized TB patients. The 
two groups of patients were comparable for 
age, race, education, marital status, pension 
status, degree of disease, and type of treat- 
ment; they differed only in length of stay in 
the hospital and the type of medical discharge 
received. 

The TAT yielded no significant differences 
between the two groups and none of the spe- 
cific hypotheses were verified. 

Eight of the determinant scores and ratios 
on the Rorschach test differentiated reliably 
between the two groups, but not at a level 
which would permit clinical prediction. While 
the patients differ significantly in degree of 
control over personal impulses, this factor 
does not in itself provide a sufficient explana- 
tion for the behavior under study. 

Drawings of the house provided seven vari- 
ables which differentiated the two groups; 
two of these differences were at a level which 
would permit prediction for an individual pa- 
tient. Subsequent application of these find- 
ings to a second sample of TB patients re- 
sulted in accurate prediction for 85 per cent 
of the cases. 

The differential accuracy in prediction for 
the three projective tests studied would sup- 
port the authors’ basic hypothesis that ac- 
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curate prediction of specific overt behavior 
from projective techniques is dependent upon 
the extent to which the test provides a meas- 
ure of the interaction between needs of the” 
individual and a symbolization of the e5- 
ternal factors of the situation in which the 
behavior occurs. 


Received September 22, 1954. 
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ae erous studies have attempted to apply 
sion ical techniques, such as multiple regres- 
a the discriminant function, to the 
or em of the psychiatric validity of the 
S ro Nach scoring categories. Typically these 
gori les attempt to isolate a subgroup of cate- 
o aS Or elements from the total profile and 
estimate a series of weights to be applied 
ou e elements which, in linear combina; 
tic ki — See ager ie 
assificatory syndromes. 
Psyc Ometric prin which minimizes the 


} = 
x 3 the clinical interpreter of 7, 
: essful whe: 

er condition th ah is when Ss alike 


p essary condition is met, i.e., We" E 
a selected group of clinical behaviors ps 

‘attic syndrome), are alike on 4 selecte! 
Stoup of Rorschach profile elements and when 


pese Ss differ on the same elements kom a 
n some other psychiatric category. er" 
of the Rorschac 


find di ; idit 
4 diagnostic vali i attributable a 


i Psychiatrically distinct c 
stinct clusters of Rorschact 3 
Occur within a given diagnostic ae 
ese clusters are still different ae 
Within another psychiatric catego 
element clustering may 
nes with Ss from differen 
More alike Rorschachwise than two possibili- 
€ same categories. These last 


University of Pittsburgh, Western Psychiatric 


The Psychiatric Validity of an Inverted Factor 
Analysis of Rorschach Scoring Categories 
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ties are suggested by the study of Wittenborn 
and Weiss (5) who reported an inverted fac- 
tor analysis of the intercorrelations on 55 
symptom-rating scales of 20 Ss with the same 
psychiatric diagnosis (manic-depressive psy- 
chosis—manic state). The absence of a gen- 
eral factor from the six extracted leads these 
authors to conclude that important subgroup 
differences exist within such a homogeneous 
psychiatric group and that these differences 
are obscured by the similar diagnostic label. 
Finally, the Rorschach elements may be in- 
terindependent and no clustering may occur. 

One promising preliminary approach to the 
isolation of clusters of Rorschach elements is 
the inverted factor analytic or Q technique. 
Factors are extracted from a matrix of inter- 
correlations between Ss (rather than from a 
matrix of intercorrelations between variables 
as in the standard R technique) and, after 
the factors are rotated to simple structure, 
the factor loadings used to group the Ss. Cat- 
tell (2, pp- 502-503) regards this method as 
especially useful in isolating subgroups within 
a nonhomogeneous population and says the 
simple structure factors should correspond to 
these population variables when the depend- 
ent variable measures are affected by the 
population variables (2, p. 511). This sug- 
gests that if we selected groups of Ss from 
distinctly different psychiatric classifications, 
selecting Ss for internal behavioral homoge- 
neity and intergroup heterogeneity, and fac- 
tor analyzed the correlations between Ss over 
a large series of Rorschach elements, the fac- 
tor loadings would permit a psychometric 
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grouping of the Ss. If this grouping corre- 
sponded to the psychiatric grouping we would 
have evidence that a psychometric technique 
could profitably be applied to a larger sample 
of Ss. 


Procedure 


Subjects. Sixteen Ss were used with four Ss 
in each of four diagnostic categories. Group 1 
Ss had all been diagnosed as paranoid schizo- 
phrenics with a minimum of disagreement in 
regard to diagnosis. In each case delusions had 
been clearly elicited and there was a history 
of markedly unusual social behavior. Clinical 
material gave evidence of unusual difficulty 
in sexual adjustment and confusion in sexual 
role or homoerotic tendencies. Group 2 Ss had 
all been diagnosed as imbeciles. There was no 
evidence in any case of brain injury or of 
special physiological determinants. Group 3 
had a diagnosis of anxiety state. Clinical ma- 
terial gave evidence of marked current anx- 
iety at the time of testing. In no case was 
there any evidence of schizophrenic person- 
ality features, bizarre thinking, or loss of af- 
fect. History material demonstrated strong 
discomfort and incapacitation from anxiety 
feelings. All four Ss were psychiatric patients. 
Group 4 Ss all had a diagnosis of involutional 
melancholia. Clinical notes (dated shortly be- 
fore and after testing) indicated that each S 
was clearly depressed at the time. Feelings of 
inadequacy, futility, and guilt were verbalized. 
The gross change in affect was the primary 
feature of the illness. 

Several hundred case records were reviewed 
in selecting Ss. The purpose of the selection 
was to insure that Ss in any one of the four 
groups not only had a similar diagnosis, but 
were also as homogeneous as possible in terms 
of the clinical picture and current status, Con- 
trols reflected this purpose. For example, the 
four Ss in Group 1 were all male; the four in 

Group 4 all female. 

Rorschach. Each protocol was scored three 
times, once by the original examiner and in- 
dependently by two other scorers for pur- 
poses of this study. Totals for variables used 
jn the present study were compared for the 
two independent scorings and inspection indi- 
cated no disagreements that would affect the 
later dichotomization of the categories. The 
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selection of Ss and scoring was under the di- 
rection of the second author who turned the 
data over to the first author for the statistical 
analysis with all identifying information (such 
as diagnosis, sex, etc.) removed. The first au- 
thor was not aware of the specific diagno 
groups involved nor the groupings of the a 
until after the factor analysis and subsequeh 
rotation of factor axes had been accomplished. 


Results 


The distribution of the 16 patients on each 
of the 42 Rorschach elements was found g 
each element dichotomized as close to & m° 
dian value as was possible. Patients scoring 
above the median on an element were scor? 


2. s. edian score 
“plus”: those falling below the bear Thus 


reflecting the correspondence between z 
ratings. Phi correlation coefficients weré “ples 
puted from each of the 120 fourfold ie 
since the assumption of normality neces ane 
for the use of tetrachoric correlations vea A 
viously not possible for the distributio”: 
many of the Rorschach elements.* | the 
The matrix of intercorrelations betwerr 3 
16 Ss was factor analyzed by the stam Mi 
centroid method, using the largest correla 7 
in each column as the communality estim e 
at each stage of the extraction process. tot 
process was terminated after the third ‘i ie 
had been estimated because of the smal f 
maining residual correlations (the medley 
the absolute magnitudes of the residuals ni 
.07). The original three factors were grap 
cally and analytically rotated to achiev 


1 The list of Rorschach elements, ranges 
sponses scored plus, and numbers of patients, inter” 
above the dichotomization points, and the phi 3 or? 
correlations between the patients and residual ee? 
relations after extraction of three factors se erate 
deposited with the American Documentation 
tute. Order Document No. 4503 from the ADI jc 
iliary Publications Project, Photoduplication sev 
Library of Congress, Washington 25, D. C, X° for 
ting in advance $1.25 for microfilm or $1.25 to- 
photocopies. Make checks payable to Chief, pho 
duplication Service, Library of Congress. 
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Inverted Factor Analysis of Rorschach 


Table 1 


Factor Loadings (Decimal Points Omitted) of Three Factors Extracted from Phi Intercorrelations of 
Rorschach Profiles of Psychiatric Subjects 


Productivity 


Factor loadings 


jabl Original 

Psychiatric P variables gin: Rotated 
group number P PQ I 0 m A B C Ie 
Teurotic 20 ei 43-32 26 ee 35 
nxiety) 40 64 23 52 —54 15 66 —02 39 58 
46 5025 -37 -28 —34 -12 —56 —06 33 
55 40 2⁄4 -38 19 —30 -45 -23 -15 27 
Depressed 4 45.25 45 -24 —14 2 01 47 28 
23 67 322 w a 39° -227 45 25 
31 5025 <30 14" 940 MR 33 
54 62 24 41-10 —22 08 02 47 23 
Paranoid 3 9 å a1 12 —09 27 27 15 —06 10 
Schizophrenic 22 17 14 =18 | 64 A -39 47 —36 50 
24 62 24 =35 —34 —07 09 —44 —21 24 
29 36 23 39 16 —28 —15 15 46 26 
Tmbecile 14 3322 77 10 =08 14: ai! OSARE 
37 oe 18 20 36 P36 01 = 154° 10 30 
53 i. ge am 51 28 <=13) O 03 40 
3 2 2 2 S 32), 00 a7 33 
is il 8 Tl ae ig 34 


Per cent of total variance 


iar as Was possible, orthogonal simple struc- 
- Both the original and rotated factors 
bilit to be bipolar, eliminating the possi- 
turi Y of positive manifold, and simple struc- 
© could not be completely achieved. 
tye attell (1, pp. 321-327) has noted that 
Te] Statistical characteristics of the hss 
eee Variables, such as test difficulty am 
te lance, can affect the magnitudes of the in- 
“correlations and factor structure. Variables 
Sh either extremely high or low difficulty level 
ee small variance, or are high in “eccen- 
D ‘city.” This is particularly important when 
zeint correlations, such as the phi coefficient, 
A used. At the empirical level, Witt 
y has shown that many Rorschach denm 
ering categories are highly related to z 
ptal number of responses given by the S. + 
the Present study this background suree 
at the factor loadings of a given 5 eye 
Unction of the proportion of his elem iS 
pored “plus” which in turn is & function 0 
his total number of Rorschach responses. ies 
Control this possibility two additional me 


ures related to the Rorschach “productivity” 
of each S were computed: the percentage of 
Rorschach elements scored “plus” for the S 
(P), and the “eccentricity” or variance of this 
percentage (PQ where Q = 100 — P). 

In Table 1 are given the original and ro- 
tated factor loadings for each of the 16 Ss 
and also the communalities (4°) and produc- 
tivity variables (P and PQ) for each S.2 

To test the above noted hypothesis of rela- 
tions between factor loadings and productivity 
variables, product-moment correlations were 
computed between each of the original and 
rotated factors and P and PQ. The obtained 
correlations, along with the intercorrelation 
of P and PQ and the multiple correlation of 
P and PQ with the factor loadings, are given 
in Table 2. Factors II and B were both nega- 
tively correlated with P and PQ, while factor 
A was positively related to P and factor III 


?The transformation matrix for converti igi 

i erting origi- 

zal st rea factor loadings has been deste 
with the erican Documentatio i 

st Mena n Institute. See 
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Table 2 


Product-Moment Correlations Between Factor 
Loadings and Productivity Variables 


Multiple 
Variables E PQ R 
Factor I .03 —.07 10 
I —.79** —.64** (83** 
m —.12 —.52* 55 
A .60* B 61* 
B —.58* —.71** om 
C -16 .23 -23 
ie — 42 4 59* 
PQ 52" 


* Significant at the .05 level. 
** Significant at the .01 level. 


was negatively associated with PQ. The mul- 
tiple correlations of P and PQ with factors II 
and B were significant at the .01 level (R = 
.83 and .75) and with factor A and the com- 
munality variable (4°) at the .05 level (R= 
-61 and .59). The multiple correlation of P 
and PQ with factor III (R = .55) was close 
to statistical significance at the .05 level. 
Since 10 of the 21 correlations were signifi- 
cant at the .05 level or better, the hypothesis 
that factor structure was affected by indi- 
vidual differences between Ss in Rorschach 
productivity appears confirmed. 

The original hypothesis of this study was 
that one or more of the factors extracted from 
the intercorrelations of Rorschach profiles of 
the 16 Ss would correspond to their psychi- 
atric classification. To test the validity of the 
loadings in discriminating among the psychi- 
atric groups, curvilinear correlations (eta) 
were computed between the diagnostic group- 
ing of the Ss and nine variables; the six origi- 
nal and rotated factors, the communality 
(A*), and the two productivity variables (P 
and PQ). In addition, the loadings on the six 
factors and the communality were corrected 
for the influence of P and PQ (see Table 2) 
by computing a multiple regression equation 
for predicting loadings from the obtained P 
and PQ values for each S and subtracting 
these predicted loadings from the obtained 
loadings. Validity coefficients (eta) were then 
calculated for these corrected values. The un- 
corrected and corrected eta coefficients can be 
found in Table 3. Both of the productivity 
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variables, P and PQ, discriminated among the 
psychiatric groups only at the .10 level (eta 
= .66 and .64). Comparison of the means a 
the four groups indicated that the imbes 
group was low on both P and PQ with t 
other three groups showing similar means. 
Rotated factor B also discriminated among 
the groups at the .10 level (eta = .63). Hoy 
ever, the comparison of the group me 
showed the imbecile group to be high on t a 
factor (the other groups again showing ee 
geneous means) and the multiple corre a 

of factor B and the productivity variables a 
and PQ) to be quite large (R = .75). k ia 
factor B loadings were corrected for their ffi 
lationship to P and PQ, the validity 
cient fell to an insignificant value (eta tates 
The promising validity of uncorrected H a 
B was apparently attributable solely to ! P 
lation to P and PQ. Six of the seven ae in 
rected factor validity coefficients dere 
magnitude when they were corrected fo jue 
relation of the factor variables to the a oe 
tivity variables, while the eta for one er: 
variable (rotated factor A) increased. A a 
correction (from .29 to a still insign! 
54), 


Discussion 


- ation Of 

In general, the results of this applicati 
inverted factor analytic methods to the a 

schach profiles of psychiatric groups are pe on 

tive. The intercorrelations between the »' ely 
the 42 Rorschach elements were relativ" 


Table 3 


ings in 
Validity Coefficients (Eta) of Factor Loadings 
Discriminating Psychiatric Groups 


Corrected 
for 
pe 
Variables Uncorrected Pand 
ó 
Factor I .24 i 
I 54 ‘2 
HI .43 “sf 
A -29 35 
B .63* 12 
Cc 15 J 
Ie 48 x 
P .66* 
PQ 64" 


* Significant at the .10 level. 
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Inverted Factor Analysis of Rorschach 


low and the three factors extracted accounted 
for only 34 per cent of the total variability. 
on iS in marked contrast with the results of 
ti ittenborn and Weiss (5) where the extrac- 
i? Sıx factors from the intercorrelation of 
fot a on 55 rating scale variables accounted 
he per cent of the total variance. This low 
factor communality militates against a clear 
tiie „Structure and consequently against an 
ics “vocal grouping of the Ss. Many influ- 
br have lowered the communality: 
rane orschach element reliability, the type of 
relation coefficient used, etc. 
eviden obtained factor structure showed no 
cate nce of validity against the psychiatric 
ables T, criterion. Only the productivity vari- 
SPonene sed on the number of Rorschach re- 
Ses, demonstrated any relation to the 
Pych latric grouping and this only because of 
fomg sion of an imbecile group of Ss. As 
to by Wittenborn (4), the obtained fac- 
* structure was related to Ss’ productivity 
ne mieh this relation was statistically elimi- 
nife the factor loadings showed no sis- 
cant relation to psychiatric classification. 
of S$ results are in marked contrast to those 
hambers (3) who found clinical inter- 
Preters of Rorschach protocols to demonstrate 
ecnificant psychiatric validity. Five clinical 
S were selected from five behaviorally de- 
à a Psychiatric categories (the four on 
© present study plus a paretic group) wit 
the selection criteria emphasizing unequivo- 
“alness of diagnosis and intragroup homoge- 
Reity in clinical behavior. Five total Ror- 
Schachs, one from each psychiatric group, 
Were submitted to 20 experienced Rorschach 
‘terpreters who were requested to alae 
attically categorize these “blind” Rorschach 
Protocols, The highly significant a aie 
Correct categorizations gave evidence °; i 
adequacy of clinical judgment in psychia 
oe noies #0 
x te k 
obably the most adequa a validity 


€xplain the differences in psychi t ap- 
Of the Rorschach profile and ie ee A 
Proaches lies in the additional clinical | hat 
Mation contained in a complete protocol Ror- 
's not present in a profile of tradition? dded 
Schach scoring categories. Basically this a the 
information is drawn from two aspects of 
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protocol: the specification that a given re- 
sponse was elicited by a particular area on 
a particular card, and the intracard and in- 
tercard sequencing of the responses. These 
sources of information are ignored in the 
usual scoring elements, but are commonly 
noted by experienced clinicians as being 
highly important in forming their judgments. 
One suggested advance in the objectification 
of Rorschach validity would consist of the de- 
velopment of methods of defining and quanti- 
fying these card-area, response-sequence, and 
profile-element interrelationships as additional 
predictors of psychiatric diagnosis. Another 
area of investigation lies in curvilinear and 
discontinuous relations among quantified as- 
pects of Rorschach performance and between 
these aspects and psychiatric diagnosis. Most 
of the heretofore developed psychometric 
methods assume rectilinearity and continuity: 
assumptions that appear quite hazardous in 
defining the structure of human personality. 
Which of these several approaches is poten- 
tially most fruitful could be decided by addi- 
tional studies of how the practicing and ex- 
perienced Rorschach interpreter makes his 
judgments and what information is most nec- 
essary to him for valid diagnosis. 


Summary 


Four clinical Ss from each of four psychi- 
atric diagnostic categories (anxiety neurotic, 
depressive, paranoid schizophrenic, and im- 
becile) were selected on the criteria of intra- 
group similarity in clinically relevant behav- 
jor and unequivocalness of diagnosis. Each S 
was correlated with every other S on their 
scores on 42 traditional Rorschach scoring 
categories and an inverted factor analysis 
computed from the matrix of intercorrelations 
between Ss. None of the three orthogonal 
original or rotated factors were significantly 
related to the psychiatric grouping of the Ss 
when the Rorschach response productivity of 
the individual Ss was statistically eliminated. 
The lack of diagnostic validity of this purely 
psychometric approach compared to the sig- 
nificant validity of the clinical judgment 
method was attributed to several sources of 
information in the complete Rorschach proto- 
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col which are ignored by the usual scoring 
categories. 
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Various Rorschach Indices as Disctiminators of Marked 
and Little Conceptual Disorganization Among 
Schizophrenics' 
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Brig the principal symptoms of schizo- 
coherence 4 disorganization of thought, loss of 
alse belie ìn speech, and the development of 
and Vj iefs (5). Goldstein and Sheerer (8) 
alter ot (16) regarded the loss or im- 
formatis t of abstract behavior and concept 
ance a as the key psychological disturb- 
Sching Schizophrenia, Storch (14) described 
Con phrenic thinking as the substitution of 
crete behavior for conceptual thinking. 
Bugo ings (12) making use of the Yerkes- 

ges Point Scale and tests of association 
of abs, Sination found marked impairment 
renia action and generalization in schizo- 
ave L A number of authors (2, 3, 8, 9, 16) 
attit reported the impairment of the abstract 
‘tude and of the ability to shift from one 
su to another. Cameron’s (4) work did not 
t sport Previous findings in that he found 
Schi abstract capacity level” to exist among 
port Phtenics provided that adequate rap- 
T and cooperation were obtained. 
( 10) the area of intelligence, Hunt and Cofer 
Ra ) have noted that schizophrenics do more 
a orly than nonpsychotics of similar mental 
S On such conceptual tests as interpreting 
ti les, noticing absurdities, finding similari- 
S, and on tests of associative thinking. 
Very author has found that the variability 
3 Performance of schizophrenics is marked, 
l nally larger than that of any control popu- 
tion. In every experiment there has been a 
ronsiderable amount of overlap in test scores 
tween schizophrenics and controls. We have 
‘From VA Hospital, Brockton, Massachusetts. 


Gorschachs administered and scored by Murray “- 
en, Boston University trainee. 


seen that even in an experiment (9) where 
very significant differences were found be- 
tween schizophrenics and normals, only 26 
of the 62 schizophrenics showed deficit when 
comparisons were made with controls of com- 
parable educational background. 

All the investigations cited above have con- 
cerned themselves with the study of schizo- 
phrenia as a single entity and have attempted 
to isolate some one factor or group of factors 
which would differentiate the schizophrenic 
from the normal or from all other types of 
psychopathology. Only in the past few years 
have systematic investigations been made of 
differences between schizophrenics. In one 
study Stotsky (15) reported that schizo- 
phrenics who remit tend to show at the out- 
set of hospitalization better intellectual and 
emotional control, greater clarity of the as- 
sociative processes, and greater ability to 
concentrate than schizophrenics who remain 
hospitalized. 

Encouraged by these findings the authors 
of the present study sought to investigate 
differences in degree of conceptual disorgani- 
zation among schizophrenics. More specifi- 
cally the purpose of this investigation was to 
examine the validity of certain Rorschach 
indices of conceptual disorganization on two 
groups of schizophrenics, one characterized 
by relatively little impairment of conceptual 
functioning, the other by a great deal of im- 
pairment. 


Predictions 


1. Since the proportion of good form re- 
sponses in a record is regarded by Rorschach 
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(13) as a measure of the clarity of associa- 
tive processes and by Beck (1) as an indi- 
cator of accurate perception of reality, pa- 
tients manifesting little conceptual disorgani- 
zation will give a greater proportion of good 
form responses. All responses containing a 
form element in them (F, M, FC, CF, FY, 
YF, and FV) will be scored for good form. 

2. Since patients with less conceptual dis- 
organization may be expected to retain greater 
ability to integrate and articulate their re- 
sponses to ambiguous perceptual stimuli, these 
patients will show a greater proportion of 
genetically good location responses.” 

3. If the number of popular responses is 
taken as a measure of the patient’s intel- 
lectual adaptability and ability to “share in 
the common way of perceiving things” (13, 
p.'198), patients with little conceptual im- 
pairment will give a greater number of popu- 
lar responses. 

4. Patients with less conceptual disorgani- 
zation should show greater retention of the 
ability to shift from one set to another. 
Therefore, they will show more shift from 


free association to inquiry for Rorschach de- 
terminants. 


Procedure 


Multidimensional psychiatric rating scale. 
Many chronic schizophrenic patients trans- 
ferred to this newly opened neuropsychiatric 
hospital from other Veterans Administration 
installations were rated just prior to transfer 
by means of the Hospital Form of the Multi- 
dimensional Scale for Rating Psychiatric Pa- 
tients (11). This form consists of 62 indi- 
vidual, unlabeled graphic rating scales which 
secure in a relatively objective and quantita- 
tive form a description of the observable be- 
havior or readily inferable traits and common 
symptoms of hospitalized patients, Reliability 
of rating is high. The scale has discriminated 
severely ill from mildly ill psychotic patients 
for the factors of conceptual disorganization, 
perceptual distortion, and motor disturbances 

11). 

: ae the 62 items of the scale, 12 factors 


2The scoring of the quality of location (whole, 
common detail, and rare detail) responses from p 
genetic point of view was accomplished by means of 
Friedman’s scoring criteria (6). 
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or dimensions of psychopathology have been 
obtained by its authors. One of these, factor 
K, “conceptual disorganization,” was selected 
as the criterion measure for differentiating pa- 
tients with marked disorganization of con 
ceptual thinking from patients with relatively 
little. Factor K is characterized by irrelevant 
and incoherent speech, a stereotyped repeti- 
tion of certain words and phrases and 4 fre- 


quent blocking in speech, a disharmony be~ 


tween the patient’s thinking and the ieee 
tone shown or expressed, and a disorientato 
for time. When present, delusional bel! 
tend to be impossible or bizarre (11, P: es 
For each patient rated by the Multidimen 
sional Scale the factor raw score on K Me 
obtained by adding the numerical vale 
the ratings on the seven scale items dee ai 
tive of the factor. The items are listed bel 


to 
1. How direct and relevant are his responses 
questions or to the topic discussed? PR i: js 
3. Are his thoughts and feelings consistent, an 
there a discernible lack of harmony betwee plow 
(Reports, smiling, that he was tortured wit 
torches all night.) B Does he 
4. How well oriented is he as to time? ) the 
know (a) the season; (b) the month; (c 
calendar year; (d) the day of the week? | a 
11. Are the elements of his speech logical ship» 
sistent and connected by some idea or relatio gi 
or do they tend to be inconsistent and disconne ter 
Rate what is most representative during the 
view. 
28. Does he repeat certain words or phe 
meaningless, stereotyped, or mechanical ashi d, oF 
29. Is his speech irregularly interrupted, halted, js 
blocked for varying periods of time because not 
not able to put the idea he has in words? (DO 
rate stuttering, stammering, or muteness here.) 
38. Is there evidence of false ideas or belies uy. 
present, are these ideas or beliefs (a) suficie 
plausible as to be accepted by a normal person not 
informed as to the facts; (b) implausible ee 
impossible; (c) impossible or bizarre (e-8» 
controlled by neighbor’s radio waves, hear 
moved, or dead) ? 


d 

Items 1, 3, 11, 28, 29, and 38 were rate 
on a four-point scale, item 4 on a five PO. 
scale. Patients obtaining a score of 10 OF f 
low for K (10 was the mean score for vA 
the reference population drawn from five iy 
hospitals) were considered to show relativ? 
low conceptual disorganization. Patients W! 
scores of 16 or greater for K (highest 17 4 
of reference population) were considere 
show high conceptual disorganization. 


sint 
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Rorschach Indices and Conceptual Disorganization 


ae ne P: atients were randomly selected 
etg ose scoring 10 or less and 16 or 
isted Fon K, and a Rorschach was adminis- 
vith: Individually to each testable patient 
i in 60 days of admission to this hospital. 
Pras os was to obtain 10 Rorschach rec- 
appr, Each group. Of the first 15 patients 
Poe in the low group, 10 cooperated 
fore atly to give scorable Rorschachs with 
oni € than six responses. In the high group 
nY 10 patients out of 23 were testable to 
k € extent of meeting the criterion of seven 
sponses to the 10 cards. 
wien bough all patients had taken Rorschachs 
ose 60 days of admission, it was consid- 
aa desirable to rerate the patients on the 
en criterion items of the scale to see 
Whether any changes had taken place. The K 
piges for all 10 lows remained constant. For 
Bee Of the highs the scores remained con- 
ant. The scores for two increased slightly. 
he tenth high, however, had shown such 
p aked improvement that his K score fell be- 
Na necessitating his elimination from the 
Stoup, As finally constituted, the total sam- 
Ple Consisted of 10 low scorers and 9 high 
Scorers on K, 
l All Subjects were white, male veterans be- 
OW the age of 60. Comparison of the two 
8toups for age, length of VA hospitalization, 
education, level of intelligence, schizophrenic 


i there any evidence reported or ae oe 
Ston or neurological deficit. All patients ha 
ronfirmed histories of schizophrenic symp- 
‘omatology, accompanied by long periods of 

°Spitalization, 

Rorsch, ach scoring. The Rorschach proto- 
Cols were scored for both free association and 
free association plus inquiry, using Hee 
System for scoring determinants, good an 
Poor form, and popular responses. For loca 
tion of responses the proportion of all a 
Or mediocre, W, D, and Dd responses athe 

Tesponses was used to oar the 
S8toups rather than considering each © W, 
Ocation categories separately. Thus, a Jus, 
D, and Dd, Friedman's (6) plus-plus, P d, 
and mediocre scores were categorized as ne 
and vague, confabulatory, and minus 
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Sponses were categorized as poor. The de- 
gree of agreement between two clinicians 
scoring location by means of Friedman’s cri- 
teria was greater than 85 %o, which was con- 
sidered adequate for this study. 

Prior to the analysis of findings both groups 
were compared for total number of responses 
(R). No significant difference was found be- 
tween the mean R of 17.8 for the low group 
and of 16.3 for the high group. 

Findings 

1. Prediction for good form. The predic- 
tion for good form was sustained at the .001 
level of significance with the low group giv- 
ing a significantly greater proportion of good 
form responses. There was actually no over- 
lap between the groups inasmuch as the high- 
est score for the highs was 70 and the lowest 
for the lows was 77.° 

Table 1 


Comparison of High and Low Patients for Rorschach 
Indices of Conceptual Disorganization 


Highs Lows 

Rorschach = A 
variable Mean Sigma Mean Sigma ¢ 2 p 
Good form 

Percent 47.0 17.1 864 60 15.4 .001 
Good location 

percent 381 23.2 826 8.2 15.4 .001 
Populars Rif ESS ES WO 8} 01 
Total deter- 

minantshift 14 1.2 31 12 24 03 


2. Prediction for location. The difference 
between the low and high groups was signifi- 
cant at the .001 level in the predicted direc- 
tion for location. Here also there was no over- 
lap on scores between the two groups, the 
highest score for the highs being 63, the low- 
est for the lows, 71, 

3. Prediction of populars. The prediction 
with regard to P was supported at the .01 
level of significance with the low group giv- 
ing almost twice as many popular responses 
as the high group. 


good form Per cent the cutting point was 75, for 
good location per cent the cutting point was 70, 
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4. Prediction for total determinant shift. 
The low group showed significantly greater 
shift (p = .03) for determinants from free 
association to inquiry. This confirms the pre- 
diction that such a group is better able to 
shift from one set to another and is more re- 
sponsive to a change in stimulus. 


Discussion 


All four predictions concerning the Ror- 
schach indices of conceptual disorganization 
were confirmed below the .05 level of signifi- 
cance. Of greater importance was the fact 
that for two of these indices, good form per 
cent and good location per cent, there was no 
overlap between the two groups. Tentatively 
these findings suggest that low scores for 
these two Rorschach variables may be taken 
to indicate conceptual disorganization among 
schizophrenic patients. 

The findings for form and populars sup- 
port the notion that the schizophrenics low 
on conceptual disorganization are able to as- 
sociate accurately to the blots and to share 
in the common way of perceiving things. The 
superior performance of the lows on the lo- 
cation categories suggests that these patients 
not only retain their ability to integrate their 
responses to the plates, but that they may 
even tend to approach the level of response 
of neurotics and normals on these variables. 

While the difference between the two groups 
for determinant shift is significant, it is note- 
worthy that neither group shifts a great deal. 
Gibby and Stotsky (7) in comparing psy- 
chotic and psychoneurotic patients found 
that the average amount of shift for the psy- 
chotic group was 3.15 while that for the neu- 
rotic group was greater, 5.15. Thus in the 
present study the psychotic patients with low 
conceptual disorganization show roughly the 
same amount of shift as the psychotics 
studied at a VA general medical and surgical 
hospital (7). The average shift for the high 
and low groups combined is much lower, 
roughly 2.3. The smaller amount of shift for 
these patients as compared with the psychot- 
ics in the earlier study may be due to their 
being more chronically schizophrenic and as 

a result of their illness probably less respon- 
sive to the shift in stimulus from free asso- 
ciation to inquiry. 
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Of what significance are the present find- 
ings with regard to schizophrenia in general? 
The definite differences, on both the rating 
scale and the Rorschach indices, between the 
two groups, both of which consisted of 
chronic schizophrenic patients, raise the ques- 
tion as to the advisability of regarding : 
schizophrenics as individuals incapable © | 
higher level thinking such as is found in nor- | 
mals. The present findings indicate that E 
are many schizophrenic patients who are a A f 
to shift from one set to another and who Ge 
integrate perceptual stimuli in a manner ee 
lar to that of nonschizophrenic subjec a 
Among such patients the schizophrenic poa 
ess does not manifest itself by marked RE 
ceptual disorganization. In fact they $ a 
minimal conceptual impairment on the mê 
ures employed in this study. 


Summary 


1. By means of 
chiatric Rating Scale, 
phrenic patients showing little conceptu ‘ 
organization and 9 chronic schizop er 
patients showing marked conceptual ©} 
ganization were selected and compare ion 
four Rorschach indices of conceptual "a0 i 
ganization: good form per cent, good lott 
per cent, populars, and determination 5 o 

2. It was predicted that patients low 
conceptual disorganization 
greater proportion of good form and u 
location responses, a greater number of po ee 
lars, and more determinant shift from 
association to inquiry than patients high as 
conceptual disorganization. All predict E 
were confirmed at significant levels of © 
fidence. rd 

3. The findings were discussed with reg% f 
to their application to the consideratio” 
schizophrenia as a single entity. 


Received August 19, 1954. 
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The Separation Capacity of the Rorschach 


Raymond J. Corsini, 


University of Chicago 


Winfield E. Severson, Thomas E. Tunney, and Harold F. Uehling 


Wisconsin Department of Public Welfare 


The Rorschach may be used to rate indi- 
viduals on single or multiple dimensions with 
respect to relative or absolute standards. Al- 
though the literature on the Rorschach has 
been concerned mainly with the adequacy of 
clinical descriptions of individuals, in some 
situations, as in a prison, it is often of greater 
practical importance to rate people with re- 
spect to one over-all quality, such as “adjust- 
ment.” For classification boards and parole 
committees the important question is “How 
is he?” rather than “What is he?” Prison off- 
cials want to know whether an individual 
placed in a particular situation of trust will 
be able to meet it effectively, and they are not 
too concerned with why or how he will suc- 
ceed. They are interested in meaningful pre- 
dictive statements and not in understanding 
individual dynamics. 

In either case, the validity of the Rorschach 
is at issue. The difficulties inherent in the 
validation of projective techniques have been 
ably summarized by Macfarlane and Tudden- 
ham (2) and need not be reviewed again. 
One kind of validation may be made by test- 
ing for criterion discrimination, that is the 
capacity of the Rorschach to separate indi- 
viduals known or believed to differ with re- 
spect to some criterion quality. However, to 
eliminate other cues, such as will occur in 
face-to-face contact between the examiner 
and the subject, it is necessary to have Ror- 
schachs evaluated blindly. This is particu- 
Jarly true in this investigation, since half of 
the subjects were prisoners, the other half 
were prison guards. 


The Problem 


In a prior paper (1) it was reported that, 
when 50 “normal” Rorschach and 50 “abnor” 
mal” Rorschachs were evaluated by means 0 
a check list, the rank-ordered ratings pa 
29 normals in the top 50 rather than t s 
chance expectancy of 25. The degree of seoa 
ration was not quite significant at the pi 
cent level. The question arises of the capacity 
of psychologists to separate such protocols i 
clinical judgment in contrast to the mechan 
cal procedure of the check list. 


Method 


The same 100 protocols used in the pin 
investigation were used in this study. The if 
normal protocols were of newly hired Pe 
guards who took the Rorschach as part of A 
routine of indoctrination into the penal E 
ice. They had passed civil service invest 
tions of their character, had the equivalent oe 
high school education, and had passed two? 
terviews designed, among other purposes; 
evaluate their emotional stability. There wg 
no reason to believe that they were m a 
way different with respect to normality 
personality from an unselected group of 
same age. If anything, they may have 50 
superior, as a result of the screening. The 
abnormal protocols were of prisoners who ha d 
committed serious felony crimes and who ha aM 
been referred to the psychologists for projec 
tive testing by the psychiatrist because in bis 
opinion they showed signs of serious perso” 
ality deviations. About 10 per cent of prison” 
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ie In this particular institution are referred 
or further intensive testing which usually in- 
cludes the Rorschach. 
ee of the guard protocols was matched 
oa at of a prisoner, Ages were balanced 
‘i oe years; only inmates who had rat- 
‘ale average intelligence, and who came 
An Cwer middle social classes, were used. 
Subjects were white. 
a he Protocols were assembled with a sum- 
ary sheet, Al] identifications were removed. 
à 3 Protocols were then given to three psy- 
fro °gists with instructions to rank them 
able, 1 to 100 with respect to the most prob- 
< € adjustment of the subjects. Psycholo- 
tne A and B were asked to take as much 
Ime as they considered necessary to make a 
800d decision, Psychologist C was asked to 
is are “snap” decisions. Psychologist D, who 
a administered all the Rorschachs, was 
ae to rank the summaries of his reports 
i ™ 1 to 100 in terms of favorableness with 
spect to adjustment. 


Results 


, P Sychologist A averaged 7.2 minutes per 
pigment; Psychologist B, 6.0 minutes; and 
Sychologist C, 1.1 minute. Time was not re- 
Corded for Psychologist D. The intercorrela- 
Hons of the rankings between the psycholo- 
8ists were very low, in terms of usual psycho- 
Metric expectations, The rankings of A and 
» A and C, and B and C, correlated only 
22, 35, and 45, respectively. The judgments 
Of these three psychologists, respectively, 
against the ratings of the report summaries 
yepated by Psychologist D, correlated .33, 

» and 50, 

By chance it might be expected that 25 of 
the normal protocols might be placed in the 
top half of the rankings. It had been found 
that through using the Davidson Scale 29 
Were placed in the top half. Psychologists a 

B placed, respectively, 34 and 12 Bo 
exceeded the 1 per cent level of significance. 

“Ychologist C, who worked very rapidly at 
the rate of about one judgment per Nok 
exceeded the Davidson Scale by placing 30 0 
the guard protocols rather than the chanas 
€xpectancy of 25, thereby just meeting the 
Per cent level of significance. All three of the 
Psychologists, who used their clinical judg- 


Table 1 


Number of Guard Protocols in Each of the 
Four Quartiles of Ratings 


Quartiles 
—— Se eee 
Psychologist I 0 Im IV 
A 20 14 10 6 
B 23 19 6 2 
(o4 18 12 12 8 
D 24 16 8 2 


ment, were better than a check list for the 
purpose of separating this population of Ror- 
schach protocols with respect to “normality.” 
Psychologist D, who had worked from his 
own summary reports, put 40 of the guards in 
the top 50. Psychologist D’s results, however, 
could be seriously contaminated because he 
saw the examinees in face-to-face situations 
and could have been influenced by clues not 
obtained from the Rorschach. The placements 
of the four psychologists in terms of quartiles 
is shown in Table 1. 3 


Summary 


The most surprising result of this investi- 
gation is the very low order of reliability, 
in terms of usual psychometric expectations, 
found in the rankings of the Rorschach pro- 
tocols by the psychologists with respect to 
normality. Of course, no information exists as 
to the range of “normality-abnormality” of 
the subjects, but presumably there was no 
attenuation due to restriction of range. 

It would appear that adequacy of judg- 
ments is a function of time spent on the judg- 
ing process. The three Psychologists were con- 
sidered equal in their abilities, but the psy- 
chologist who made the “snap” judgments 
did more poorly than the other two who 
worked at what they considered optimal 
speed. The best score of all, obtained by Psy- 
chologist B, a new employee of the Depart- 
ment of Public Welfare, was obtained despite 
the fact that he had not known that the pro- 
tocols were of guards and prisoners, 

The Davidson Rorschach Adjustment Scale 


gists, 60, 68, and 82 per cent from the proto- 
cols, and the psychologist working from his 
own reports, 80 per cent. 
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It may be concluded that psychologists’ 
clinical judgments of Rorschachs, while quite 
deficient in agreement with one another, are 
nevertheless superior to the Davidson Ror- 
schach Adjustment Scale for the purpose of 
separating two groups of adults who differ 
with respect to over-all social adjustment. 


Received September 27, 1954. 
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The Effect of the Psychotherapist’s Personal 
Analysis Upon His Techniques’ 


Hans H. Strupp 


Washington, D. C2 


ime Previous publications have presented 
ive evidence on (a) the techniques of 
Fe and psychoanalytically oriented psy- 
ior pra (5), and (ò) the verbal behav- 
chiatr; Psychiatrists, psychologists, and psy- 
ex "IC social workers of varying levels of 
Perience (6). These articles also set forth 
° rationale for focusing attention upon the 

P achotherapist and for studying systemati- 
bras, the concomitants of his techniques. The 
in Sent paper is an extension of the previous 
quiry, and attempts to answer the question: 
Aan i S the effect of the therapist’s personal 

YSIS upon his therapeutic techniques? 

Since the time of Freud no training require- 
ment for the psychotherapist has been consid- 
seo, more important than his personal analy- 
SIs, and the curricula of psychoanalytic train- 
Mg institutes have traditionally been built 
round this aspect of the candidate’s training. 
n view of the voluminous literature on the 
Subject, little need be said about the argu- 
ments commonly advanced in favor of this 
‘raining requirement. Fromm-Reichmann’s 
Summary, while perhaps unduly restrictive, 1s 
representative of current thinking: “And so 
t is that, because of the interrelatedness be- 
` Thi icle i ird in a series of investiga- 
fons rok le OS Ot aN study of wien 
rapists’ verbal operations, and represent a jop 
Phase of the author’s doctoral dissertation SUM Sn 
to the Graduate Council of the George vinas 7 
terial was presente 


niversity (4). Part of this american Psychologi- 
ber 1954. The 


iation to Dr. 


Orothy E, Green for valuable Ne the author held 
Department of the 
f the Army. Neither 
with this research. 


tween the psychiatrist’s and the patient’s in- 
terpersonal processes and because of the in- 
terpersonal character of the psychotherapeutic 
process itself, any attempt at intensive Psy- 
chotherapy is fraught with danger, hence un- 
acceptable, where not preceded by the future 
psychiatrist’s personal analysis” (2, p. 42). 

If this position is correct, the experience of 
personal analysis should have a demonstrable 
effect upon the character of the therapist’s 
operations. Even if present-day methods for 
objectively examining such an elusive vari- 
able are crude, there must be systematic dif- 
ferences between the techniques of therapists 
whose training has included personal analysis 
and those whose training has not. After the 
exploration of this general hypothesis, the 
problem will be pursued with reference to a 
few salient therapeutic situations. 


Three Kinds of Patient Maneuvers 


Suicide threats. A suicide threat is one kind 
of power operation by which the patient at- 
tempts to bring a significant person under his 
control. The reaction is, of course, the cul- 
mination of a long series of frustrations, re- 
buffs, and injuries which haye been inflicted 
in reality or fantasy upon the victim, and 
constitutes a grandiose attempt at revenge by 
turning the tables upon the perceived aggres- 
sor. Without attempting to give the dynamics 


Operationally, „self-destructive threats ex- 
pressed by a patient may serve to evoke the 
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therapist’s pity and commiseration, they may 
be designed to perpetuate a dependent rela- 
tionship, or they may represent a maneuver 
to dominate and to make the therapist re- 
sponsible for the patient’s actions. 

With regard to recommended therapeutic 
approaches, Fromm-Reichmann states: “A 
thorough investigation of the validity of the 
causes for the patient’s discouragement, un- 
happiness, or despair must be the starting 
point of every therapeutic approach to sui- 
cide, or suicidal attempts and fantasies” (2, 
p. 198). By the same token, reassurance, pity, 
etc. appear to be ill-advised: “If the therapist 
offers encouragement to patients’ parataxic 
expectations by actually falling into the role 
of practical adviser, he retards the process of 
insight into the immature character of such 
expectations; hence he retards the process of 
resolving them” (2, pp. 208-209). 

The following hypothesis tests whether 
therapists do what they preach: 


Hypothesis 1. When confronted with sui- 
cide threats, psychotherapists include in their 
responses (a) a relatively large number of 
explorations; (b) a relatively small number 
of responses that convey reassurance; and 
(c) a relatively small number of interpreta- 
tions. 

„If the therapist who has undergone per- 
sonal analysis is more clearly aware of the 
dynamics of the situation, Hypothesis 1 may 
be extended by stating that the predicted 
trend is more pronounced for therapists whose 
training has included personal therapy. 

Transference reactions. In its special psy- 
chotherapeutic meaning, transference refers to 
all processes whereby the patient re-enacts in 
the therapeutic situation unresolved interper- 
sonal conflicts, and casts the therapist into 
the role of the significant adult who figured 
prominently in the earlier experience. Trans- 
ference constitutes the cornerstone of all 
modern conceptions of psychoanalytic ther- 
apy and is increasingly utilized by other 
forms of therapy as well. This emphasis also 
implies that a significant segment of the 
therapeutic work consists in clarifying the 
doctor-patient relationship and concomitantly 
the distortions which complicate the Patient’s 
living. 
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The giving of interpretations has to be 
carefully planned and timing is all-important. 
Interpretations which are offered prematurely, 
that is, before the establishment of a rela- 
tively durable doctor-patient relationship and 
relaxation of the patient’s emotional defenses, 
are useless if not positively harmful. Still, 
transference reactions manifested by the pa- 
tient at almost any stage of the treatment 
are likely to be dealt with by means of inter- 
pretations, particularly by analyzed thera- 
pists who themselves have been exposed to 
the psychoanalytic maxim of giving ge 
attention to transference phenomena. e 
second hypothesis is: 

Hypothesis 2. When confronted with trans- 
ference reactions, psychotherapists employ 4 
relatively large number of interpretations: 
Analyzed therapists exhibit this tendency t° 
a greater extent. is 

Schizoid productions. The third hypothes i 
deals with the productions of a single paraa 
who appears seriously disturbed, and W. 
gives the impression of being on the verge ° 
a schizophrenic break. It appears plaust h 
that such a patient would be treated pior 
ently early in therapy than one who 1s le s 
disturbed, anxious, and confused. For oe 
thing, the therapeutic effort obviously ee 
be directed at bringing about a diminutio" 
rather than an increase in anxiety; /for aA 
other, the therapist must attempt to obs 
a fuller picture of the underlying dynam 
Since the technique of silence is often use 
create “a sort of vacuum [which] pushes i 
patient into taking the initiative in the rel; 
tionship” (7, p. 221), it increases of nee 
sity the patient’s anxiety, for which reaso” 
would be contraindicated with a very anxiov i 
patient. As for the second objective, & ie 
number of exploratory questions may be 9” 
ticipated. On the assumption that the 2% 
lyzed therapist will be more sensitive tO, 
requirements of the situation, Hypothesis 
may be stated: a 

Hypothesis 3. When confronted with tbi 
productions of a seriously disturbed, near 
psychotic patient, psychotherapists employ 
(a) a relatively small number of silent 1° 
sponses, and (b) a relatively large number ° 


explorations. Analyzed therapists follow this 
trend in more clear-cut fashion. 


y 
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Method, Procedure, and Subjects 


A fuller description has been given in the 
earlier article (6). For the present, it suffices 


series of 27 cards containing short paragraphs 
of patient statements selected from published 

Crapeutic interviews. Included in the series, 
which was considered a fair cross section of 
verbalizations heard from neurotic patients 
m early interviews, were four suicide threats, 
SIX transference reactions (including an in- 
atent request for direct advice, denials of 
k c3 need for therapy, and examples of com- 
Petitiveness and open hostility), and six com- 
Plaint Statements of a seriously disturbed 
Rear-psychotic patient.’ 


Table 1 


The Sample by Professional Affiliation, Experience 
Level, and Personal Analysis 


Personal No personal 
analysis analysis 
Se eee 

In- Sub- In- Sub- 


Exp. exp. total Exp. exp. total Total 
Psychiatrists 4 3 i7 cae 8 25 


Group 


Sychologists Cm S 6 (eR! 1 7 
Sychiatric 
Social 3 9 


Workers tuj 7 di el 
11 41 


Total 93 7 30 2 9 
Doe Gem 


Subjects were the same 25 pecs eed 
Psychologists, and 9 psychiatric social igea 
ce "ho participated in the previous and 
(6). an were psychoanalytically orien ail 
Length of experience in psychotherap, fie 
from 1 to 12 years, with a median of 5 yi ists 
Practically all of the experienced E 
(S years and above), and about hal 


rs 
Mexperienced therapists (less a a 
ad undergone personal analysis a in Table 
their training. These data are shown was ob- 
l. While no systematic information Ai 
tained concerning the length of seen that for 
Personal analysis, it is safe to a i extensive— 
the most part it had been fairly siden?) xe 
ari ilden,” re- 
? Adapted from Rogers’ case i a Professor 
Ported in Snyder (3); by permissi 
nyder, 


Table 2 
Brief Description of Scoring Categories 


Category 
number 


1 Reassurance 
2 Not applicable* 
3 Silence 

(passive acceptance) 
4 Structuring 
5 Interpretation 
6 
7 
8 


Core meaning 


Reflection of feeling 
Factual questions 
Exploration 
9 Not applicable* 
10 Passive rejection 
11 Not applicable* 
12 Antagonism 


* Probably a function of the experimental conditions under 
which responses were elicited, 


certainly beyond one year. A few therapists 
who had only recently started their analysis 
were included in the unanalyzed group. 


Results 


Quantification of therapists’ responses was 
accomplished by means of Bales’ (1) system 
of interaction process analysis. A total of 
1,609 score units was categorized by this 
method. Rater agreement was tested on a 
stratified random sample of 370 score units 
(10 cases) and found to be 78 per cent. A 
brief description of the scoring categories is 
given in Table 2.4 

Figure 1 presents the Tesponse profiles of 
analyzed and unanalyzed therapists, regard- 
less of professional affiliation, The statistical 
analyses test the significance of Percentage 
differences in a particular response category; 
¢ values significant at the :01 or .05 level are 
indicated in the figure. The findings may be 
summarized as follows: 

1. The two Tesponse profiles show consid- 
erable overlap in several of the major cate- 
gories; nevertheless, a chi Square computed 
on an over-all basis js significant beyond the 
-001 level of confidence. 


*For a fuller description of the scoring categories, 
see the earlier Publications (5, 6). 


40 — PERSONAL ANALYSIS 
-- NO ANALYSIS , 


1 3 4 5 6 7 8 10 12 
CATEGORIES 


Fig. 1. Response distributions of analyzed and un- 
analyzed therapists (personal analysis, x = 1,173; no 
personal analysis, n = 436). 


ance) responses, and conversely that unana- 
lyzed therapists are more passive. 

3. Small, but statistically significant differ- 
ences in Categories 10 and 12 (passive rejec- 
tion and antagonism), while possibly quite 
real, are based upon small frequencies and 
should be regarded as tentative. 

Since the mean length of experience of 
analyzed therapists was significantly greater 
than that of unanalyzed therapists (F = 
6.33, p < .05), there was reason to question 
whether the significant difference between 
analyzed and unanalyzed therapists with re- 
spect to the number of silent responses was 
attributable to personal analysis, or whether 
it was rather a function of length of experi- 
ence. The analysis of covariance technique 
was employed to determine whether the dif- 
ference between the number of silent re- 
sponses by analyzed and unanalyzed_ thera- 
pists was significant when the effect of 
experience was controlled. The obtained F 
value of 9.39 (p < .01) indicates that, as far 
as the present data are concerned, the differ- 
ence in silent responses between analyzed and 
unanalyzed therapists is attributable to the 
variable of personal analysis. This result was 
to be expected since the correlation between 
length of experience and number of silent re- 
sponses is .12, which is not significantly dif- 
ferent from zero. 

To test the three specific hypotheses, thera- 
pists’ responses to each subseries (suicide 
threats, transference reactions, and schizoid 


5 The findings reported for Rogerian therapists (5) 
corroborate this result. 
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productions) were compared with responses 

to all other statements. These operations were 
performed separately for analyzed and for + 
unanalyzed therapists. Subseries respone 
were, of course, always excluded from the 
over-all frequencies. 

Suicide threats. Figure 2 shows the E 
sponse profiles of analyzed and inanir 
therapists to suicide threats and to all ot 
statements. The following differences may e 
observed: 


1. Unanalyzed therapists give a jare 
number of reassuring responses (Category 
to suicide threats; for analyzed practitioners 
the trend is in the same direction (4 = 1-93 

< .06). A 
” 2. na therapists disclose a signif- 
cant decrease in reflective responses (Cate 
gory 6). 


ANALYSIS 


—OVER-ALL 
----SUICIDE 


1 3 4 5 6 7 8 
CATEGORIES 


40 
35 
30 

525 

© 20 

æ 15 

w 

a lọ 


NO ANALYSIS 


CATGORIES 


Fig. 2. Response distributions of analyzed and ve 
analyzed therapists to suicide threats and to all 0 aed 
statements (personal analysis: suicide, 2 = 182; 0V ; 
all, 7=991; no personal analysis: suicide, ” 7 
over-all, n = 372). 


i aree 
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40 ANALYSIS 1. Both groups show an increase in inter- 
35 pretive responses (Category 5), but the dif- 
b 30 — OVER-ALL ference is statistically reliable only in the 
BG os “TRANS EERE RCE: case of the analyzed therapists. 
2 2. Both analyzed and unanalyzed prac- 
m 20 titioners tend to give a larger proportion of 
& 1S silent responses (Category 3), but again the 
10 difference is significant only for the former 
5 group. It should be recalled here that this 
o category revealed a significant discrepancy in 
' 3 4 5 6 7 8 10 i2 the comparison of over-all distributions, un- 
CATEGORIES analyzed workers exceeding the analyzed 
therapists. 
3. Increments in structuring (Category 4) 
a and decrements in exploratory responses * 


(Category 8) are apparent for the analyzed 
group. These trends appear to be paralleled 


30 NO ANALYSIS by the unanalyzed group, but here the differ- 


40 


35 
30 


ANALYSIS 


——OVER- ALL 
~---SCHIZOID 


(3 4 5 6 7 
CATEGORIES o 


Fi istributl f analyzed and un- 
1g. 3. Response distributions o: CATEGORIES 


1 3 4 5 6 ? 8 WO i 


analyzed therapists to transference reactions ana to 
all other statements (personal analysis: transi ora 
ET 273; over-all, n=900; no personal analysis: 
transference, n = 99; over-all, n = 337). 


j ference 
3. Both groups show a slight pre 
for structuring responses (Category 4) ae 
dealing with suicide threats; however, jase 
difference is significant at the .05 level K n 
lyzed group: ¢= 1.63, p < .11; unanaly: 
&roup: ¢ = 1.94, p < .06). ord- 


is in acci 
ve outcomes is in ac 
None of the abo in fact, the incre- 


ance with Hypothesis 1; is in opposition 


i ; i 
Ment in reassuring ano unanalyzed 


to the prediction, excel : larger 
therapist r to give a relatively larg A 

pists appeal : onses than do ana: 4 5 6 7 8 10 {2 
Number of reassuring resp CATEGORIES 


lyzed workers. A compares 
Transference reactions. ome an Penns Fig. 4. Response distributions of analyzed and un- 
the rofiles of analyz Wonsand analyzed therapists to schizoid Productions and to all 
response p nsference reac 1 other statements (personal analysis: schizoid produc- 
lyzed therapists to tra The following observa- tions, n = 274; over-all, n =899; no personal analy- 
= to all other statements. sis: schizoid Productions, = 94; over-all, n= 342), 
tions may be made: 
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ences are not significant, probably because 
the absolute numerical frequencies are con- 
siderably smaller. The difference in Category 
7 is inconsistent and may be due to chance. 

Hypothesis 2, which predicted an increase 
of interpretive responses, is thus partially 
confirmed; however, the verbal behavior of 
analyzed therapists seems to follow the same 
trend as that of their unanalyzed confreres. 
Collateral statistical treatments indicated that 
psychologists and social workers do not con- 
tribute to this shift. 

Schizoid productions. Figure 4, which pre- 
sents the by now familiar comparisons for 


schizoid productions, leads to the following 
interpretations: 


1. Analyzed therapists’ responses are char- 
acterized by a marked decrease in silent re- 
sponses (significant at the .05 level), whereas 
unanalyzed therapists reveal an increase (not 
statistically significant). 

2. Analyzed therapists use a proportionate 
number of explorations with this patient; 
unanalyzed workers, on the other hand, give 
significantly fewer exploratory responses. 

3. The differences in Category 7 (direct 
questions) are traceable to an artifact in the 
items of the subseries. Another inconsistent 
difference in Category 6 may be due to 
chance. 

Hypothesis 3 is partially confirmed by 
these results, particularly with respect to the 
decrease in silent responses for analyzed 
workers. If it is recalled that analyzed thera- 
pists were shown to be more active in the 
over-all comparisons, it follows that the gap 
between the analyzed and the unanalyzed 
groups is widened when responses to this pa- 
tient occupy the focus of the statistical treat- 
ment. Exploratory responses, while undergo- 
ing no shift in the case of analyzed thera- 
pists, reveal a pronounced decrease in the 
unanalyzed group. This result is likewise in 
the predicted direction. 


Discussion 


In interpreting the results of this study cer- 
tain limitations must be kept in mind: 


1. Therapists’ responses were secured by 
means of an experimental model whose va- 
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lidity remains to be tested. It is thus not 
known to what extent the therapist’s behav- 
ior in the experimental situation coincides 
with his behavior vis-a-vis a patient. : 

2. The experimental statements were brief 
and out of context; there was a minimum 
of background information on each patient; 
and, of course, the all-important therapist- 
patient relationship was lacking. 

3. The three specific hypotheses were tested 
only in an approximate manner, and the tests 
are altogether relative since the reference 
distributions were composed of heterogeneous 
elements whose representativeness 1S not 
known. The number of suicide, transference, 
and schizoid items, moreover, was small so 
that reliable differences were difficult to dem- 
onstrate. 3 

Within these limitations, the present 1- 
vestigation provides objective evidence On A 
problem about which much has been will 
but on which no quantitative data have y¢ 
been adduced. d 

The finding that analyzed therapists eee 
to be more active than their unanalyzed co 7 
leagues is a provocative one, but it ae, 
counter to an intuitive hunch to the effect 
that the experience of personal analysis a 
ables the therapist to maintain distance fro 
the patient’s maneuvers, and consequen 
that he feels less compelled to respone 3 
any and all of the patient’s communicatio 
Rather, the present results may signify t a 
the analyzed therapist is more skilled or a 
willing to formulate an immediate respons” 
An alternative interpretation might be i 
the unanalyzed therapist is more passive we 
confronted with a series of patient stateme? 
in an experimental setting, but that this tren! 
would be reversed in actual therapy- 
might be more wary, more hesitant, ons 
more unsure of himself and of his ther 
peutic procedures when called upon to ee 
an account of himself, so to speak, to an on 
sider. It must be remembered here that len8 
of experience per se does not account for 
difference which, by this evidence, seems 
be due to personal analysis or some rela 
variable. i 

With respect to suicide threats, it is Se A 
that contrary to recommendations made ue 
the literature, all therapists tend to empha 


to 
ted 
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size reassuring responses. At the same time, 
we may observe a consistent but statisti- 
cally not significant increase in structuring 
Tesponses which attempt a clarification of the 
Patient’s and the therapist’s roles in the treat- 
ment situation. Such responses emphasize the 
reality aspects in opposition to the parataxic 
Character of the patient’s perceptions. The 
latter finding, however, must be regarded as 
very tentative, Also, it should not be for- 
gotten that exploratory responses, while evi- 
dently not subject to shift in this instance, 
account for about a third of all therapist re- 
Sponses, 

In accordance with psychoanalytic theory, 
therapists appear to single out transference 
Phenomena for interpretive attention, al- 
though the experience of personal analysis 
Seems to have little effect on the therapist’s 
Verbal behavior in this case. As has been 
shown earlier (6), a predilection for inter- 
Pretations is a distinguishing feature of all 
Psychiatrists, The data would indicate that 
transference reactions act as a signal for the 
therapist to interpret, to be silent, or to de- 

ne the therapeutic situation. Also, he seems 
to be less inclined to ask the patient for an 
elaboration of his feelings. However, since 
the findings for the smaller unanalyzed group 
lack Conclusiveness, it would be less than 
Cautious to attribute the observed differences 
to the variable of personal analysis. — 

The data presented for the productions o 
a very anxious and near-psychotic patient 
Point to differential handling by analyzed 
and unanalyzed therapists, and tend to con- 
firm the third hypothesis. Silent responses ee 
Pear to be sensitive to this kind of BRam 
material such that analyzed ther Spies s 
Come more active (the evidence is not The 
clusive for unanalyzed practitioners). na- 
decline in exploratory responses by E of 
lyzed therapists may be the comp e re- 
this trend. In the context of the at 
Sults, this may perhaps be regarded as ist’s 
tive evidence for the analyzed heath the 
Sreater sensitivity to the demand oa 
therapeutic situation; and if one itude of 
underlying silent responses is the atti indi- 
“playing it safe,” there may be sete 

; % greater 
Cation of the analyzed therapist’s E 
Versatility and readiness for verbal pa! 


e ean 
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tion. However, this extrapolation is clearly a 
speculation. 

In conclusion, this study has presented in- 
complete but certainly provocative evidence 
concerning differences in the therapeutic be- 
havior of analyzed and unanalyzed psycho- 
therapists. Contrary to prediction, personal 
analysis seems to lead to greater rather than 
to diminished activity on the therapist’s part. 
The implications as well as the generaliz- 
ability of these findings remain to be ex- 
plored further, but there can be no doubt that 
the problem is one of the first magnitude— 
for theory, for practice, and for training. 


Summary 


This is the third and concluding article in 
a series of investigations to elucidate the psy- 
chotherapist’s contribution to the treatment 
situation. It studies the effect of the thera- 
pist’s personal analysis with reference to a 
series of patient communications and to (a) 
suicide threats, (5) transference reactions, 
and (c) schizoid productions. Therapeutic re- 
sponses were secured from 25 psychiatrists, 
7 psychologists, and 9 psychiatric social work- 
ers of varying degrees of professional experi- 
ence by presenting a series of 27 patient 
statements extracted from actual therapeutic 
interviews. A total of 30 therapists had un- 
dergone personal analysis as part of their 
training. Therapists’ responses numbering 
1,609 were categorized by Bales’ system of 
interaction process analysis, Average rater 
agreement was 78 per cent. The major re- 
sults may be summarized as follows: 


1, Compared with unanalyzed therapists, 
analyzed practitioners tend to be more ac- 
tive, as evidenced by a significantly smaller 
number of silent responses, 

2. Suicide threats evoke an increased num- 
ber of reassuring responses from both thera- 
pist groups. 

3. In dealing with transference phenomena, 
analyzed therapists tend to prefer interpreta- 
tions, silence, and structuring responses. The 
results for the unanalyzed group are incon- 
clusive. 

4. Schizoid productions of a seriously dis- 
turbed patient appear to induce a smaller 
number of silent responses in analyzed thera- 
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pists and a smaller number of exploratory re- 
sponses in unanalyzed therapists. Since the 
foregoing results are. significant only for one 
group, they must be considered tentative. 

Within the limitations of this study, per- 
sonal analysis has a demonstrable effect on 
the therapist’s verbal behavior. It was shown 
that this effect is independent of the thera- 
pist’s level of experience. 

This series of investigations has indicated 
the feasibility of studying objectively some 
aspects of the psychotherapist’s techniques. 
There is reason to believe that this focus on 
the therapist’s contribution to the treatment 
situation is of theoretical and practical value 


for advancing our knowledge of the process 
of psychotherapy. 
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Changes in the Self Concept Without Psychotherapy’ 


Donald M. Taylor 


Vanderbilt University * 


me ychologists approaching the problem of 
that a lon of psychotherapy have reported 
cept s number of alterations in the self con- 
rated fen to accompany “improvement” as 
6), Roy, the therapist. Studies by Raimy (5, 
» Nogers (7, 8, 9), Hartley (3), Dymond 
chan and others indicate that the following 
ges are characteristic: 
1. The self concept becomes more positive. 
selfiea, 0S more congruent with the 
ae becomes more self-consistent. 
mae then, might be considered possible 
culty h, for success in counseling. One diffi- 
conce as been the lack of information on self- 
tietan changes which take place without 
on o PY. Dymond (2) has summarized data 
pare control group of 15 noncounseled sub- 
ent at the University of Chicago Counseling 
in a Which indicate no significant change 
peresitive-negative adjustment score over @ 
Od of several months. 


Problem 


cept obtain data on changes in the self con- 
Self-¢, Or persons not receiving counseling, a 
repli oncept scale was devised and utilized in 
adia Q-sort descriptions of self by 147 

8e students and 21 adults in evening CO™ 


ege extension classes. 
ion ause the process of repeated iin oTa 
n on the self might be expected to lead to 
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flan upon a dissertation submitted in partial 
igen of the requirements for the Ph.D. degree, 
is crbilt University, The writer wishes to express 
and vctitude to Dr. George E. Copple for his advice 
guidance, n 
Summar i i ented at the 
19. y of this article was pres l f 
Ba Meeting of the Southern Society for Philosophy 
2 Psychology, 
ices f e writer is now Director of Psyc) 
Or the Tennessee Department of Men 


ological Serv- 
tal Health. 


some of the self-insights anticipated in ther- 
apy, it was hypothesized that self-concept al- 
terations similar to those reported in success- 
ful counseling would be revealed in repeated 
self-descriptions without psychotherapy. The 
Q-sort methodology was employed to permit 
comparison with results of recent research 
projects dealing with changes accompanying 
therapy which have made use of this tech- 
nique (2, 3, 4, 7, 8, 9, 10). 

The self concept was defined as the indi- 
vidual’s phenomenologically unitary constel- 
lation of beliefs about and attitudes toward 
himself, the organization of his self-reflexive 
affective-cognitive structures,® as reflected op- 
erationally in his description of himself. 


Method 


Items for the Q-sort self-concept scale were 
derived from 200 anonymous self-descriptions 
by university students and urban adults. Self- 
statements were classed as positive or nega- 
tive on the basis of ratings by a panel of 
eight judges. A preliminary set of 180 items 
was reduced to the final 120, 60 positive and 
60 negative, by item analysis of a pilot study 
with 26 subjects. 

Subjects were asked to describe themselves 
in terms of these items by distributing the 
self-statements into eleven categories, using 
a platykurtic seminormalized distribution, 
shown in Table 1. The same items and the 
same distribution were employed for descrip- 
tion of the self-ideal, defined operationally as 
the subject’s description of the self he would 
like to be. 

This design makes it possible to correlate 
item by item, the pattern of self-description 


8 Definition formulated by the Vanderbilt-Peabody 
self-concept research group, directed 
ee , by Dr. Ted 
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Table 1 
Card Distribution in Q-Sort Procedure 


No. of 


cards 


Most like me 11 6 


Interpretation Category 


mW UANTOO 
= 
S 


Least like me 


for any single individual with his own replica- 
tions and with the description of the self- 
ideal. Furthermore, since a score in the range 
between 1 and 11 points is assigned each 
item by placing it in one of these 11 cate- 
gories, a positive self-concept score may be 
obtained from each sorting by summing the 
scores assigned the 60 positive items. 

In a test-retest reliability study, 120 col- 
lege students described themselves twice, with 
the sortings separated by an interval of one 
week. Mean of the product-moment correla- 
tions of individual items for the two sortings 
for the 120 subjects was .79 + .02. The re- 
liability coefficient for the positive self-con- 
cept scores obtained by summing points as- 
signed the 60 positive items was .95 + .03. 

In testing the hypothesis that changes simi- 
lar to those reported in psychotherapy would 
be found for persons engaged in self-intro- 
spection by way of repeated self-description, 
20 undergraduates and 6 graduate students 
were used as subjects. Four of these were 
adults in evening extension classes. The seven 
subjects in the intensive self-concept group 
made ten self-sorts in five days, two per day. 
Fifteen subjects in the self and self-ideal 
group also made repeated self-descriptive 
sortings in a five-day period, with two or 
three self-ideal Q sorts interpolated. In the 
group of four used for study of changes over 
a longer period of time, three made ten self- 
sorts at irregular intervals over periods vary- 
ing from one to three months in length, while 
one subject completed 21 sortings in seven 
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different environmental contexts over seven 
and one-half months. 


Results and Discussion 


Positiveness of self concept. With the Lal 
strument employed in this research, a positive 
self-concept score in the range 223-497 points 
may be obtained by placing the 60 positive 
items in the 11 available categories. If pos 
tive and negative items are assigned equa 
importance in the self-description, the per 
tive score is 360 points with an equal bt 
for the negative items. For the 120 subjec S 
of the reliability group, the mean positive 
score on the first sorting was 421.25 points, 
with a range of 262 to 492, and 105 subjects 
(88%) scoring themselves positively or git 
the 360-point neutrality total. The mean 7 
the second sorting a week later was 426.1 i 
a mean gain of 5.63 points, statistically 5'8 
nificant at the 1% level (Table 2). DE 

The gains were substantially greater for in 
subjects who made repeated self-sortings ia 
the brief period of five days. The mean gi 
crease in positiveness for the seven SI 
describing themselves twice daily for pA 
consecutive days was 23 points, a change 5'E 
nificant at the 2% level, even for this PAN 
N. For the 15 subjects interpolating self-i a 
descriptions within the self-concept repli 
tion series, the mean increment was 17 po!” ; a 
again significant at the 2% level, using i 
each case the one-tailed test of significan 
appropriate where the change is in the dire 
tion predicted. For the four subjects wh? 


Table 2 


P ed 
Increase in Positive Self-Concept Score with Repeat 
Q-sort Self-Description 


Mean 
First Last Bee 
Group N Sorting Sorting on 
Reliability 5.63 
group 120 421.25 426.78 3 
Intensive ee 
self-sorts 7 43300 455.86 2286 
Self and self- 6 93** 
ideal sorts 15 431.00 447.93 16. 
Scattered 2.15 
self-sorts 4 436.75 439.50 a 


* Significant at 1% level. 
** Significant at 2% level. 
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Changes in Self Concept Without Psychotherapy 


T were scattered over periods of one 
Miera, and one-half months, with temporal 
which ie er like those found in research in 
changes ee sort has been used to follow 
gain was S in theip, the seen 
(Table 2), ghtty less than three poin 
ae Zond appear, then, that self-introspec- 
self-des Ha ind induced by repeated Q-sort 
to be par s ina short time interval tends 
of self. ccompanied by increased positiveness 
ell-attitude, like that reported for therapy. 
oe would seem, however, to be of 
in co Smaller magnitude than that reported 
cone unseling. The gain in positiveness of self- 
(2) Pl t adjustment score noted by Dymond 
was or 25 subjects receiving psychotherapy 
an Le oriinately 38%, as compared with 
ject o increase in positiveness for the sub- 
re. S of the intensive self-sort group in this 

Search, and 8% for the self and self-ideal 

&roup. 
a lationship between self concept and selj- 
Kan Fifteen subjects in the experimental 
aor, made repeated self-concept sortings 
ith self-ideal Q sorts interpolated within 
Sead and at the conclusion. All of these 
fae sorted the items to describe the ideal 
self at least twice, once following the first 
s sort, and once at the conclusion of the 
eries on the fifth day. E 
self. b mean correlation between the initial 
in, “description and the first self-ideal sort- 
ac, Was .52, which would seem to indicate a 
rs stantial relationship (Table 3). But the 
“hg for individual subjects was from 04 
F ‘79, reflecting wide individual differences. 

Urthermore, the mean positive score for the 
pelt ideal was 493 points, exceeding the mean 
ot the self concept (424) by 69 points, & 

ference significant at the 1% level. Thus 
hough there seems usually to be a positive 
relationship between self concept and self- 
ideal, there is also usually a significant dif- 
ference, 

With replication of descriptions of self and 
Self-ideal over the five-day period, the mean 
Positive correlation between self-concept and 
ideal self increased from .52 to .66, a gain 
Significant at the 19% level for the 15 non- 
counseled subjects. This is the trend reported 
™ successful psychotherapy, as illustrated in 
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Table 3 
Change in Relationship Between Self Concept 
and Self-Ideal 
Correlation 
Group or First Final 
individual sorts sorts 
Experimental group 52 .66* 
(N = 15) 
Rah 04 —.18 
Mrs. Oak .21 .69 
Zar 18 81 


* Difference significant at 1% level. 


Rogers’ case of Mrs. Oak (9) with the posi- 
tive relationship between self and self-ideal 
rising from .21 to .69, and in Hartley’s case 
of Zar (3) with the correlation increasing 
from .18 at the beginning to .81 at the con- 
clusion of counseling. The increment is much 
smaller for members of the experimental 
group than for the two counseling cases, how- 
ever, with the greatest gain for a subject not 
receiving counseling being from .43 to .74 in 
five days. The changes reported in counseling 
took place, of course, over a period of months. 
For one subject in the experimental group, 
Rah, the only one with an initially negative 
self-concept score of the type often found in 
persons seeking therapy (330 points), the re- 
lationship actually dropped from .04 on the 
first pair of sortings to — .18 for the last pair, 
when the positive score had fallen to 315 
points. 

Thus it appears that repeated interacting 
introspection on the self and the ideal self 
tends to lead to increased positive relation- 
ships like those reported in therapy, though 
of lesser magnitude. And as in therapy, the 
description of self tends to be altered more 
than the self-ideal, though changes took place 
in both for all subjects. 

Consistency of the self concept. Brownfain 
(1) has reported a significant positive cor- 
relation between: consistency of self concept, 
and adjustment as indicated by inventory 
scores and social relationships. Rogers (9) 
has noted an increase in consistency of self- 
description in the case of Mrs. Oak, not only 
through the therapy period but also in fol- 
low-up studies, from an initial correlation of 
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.50 for the first two self-sorts to .70 for the 
last pair. 

For the experimental subjects in this re- 
search project making ten self-sorts in five 
days, the mean correlation of item scores for 
the two self-descriptions on the first day was 
-88. The mean correlation for the last pair of 
self-concept sortings on the final day was .98. 
This difference is significant at the 1% level. 
For the 15 subjects making both self and 
self-ideal sortings, the increment was from a 
mean of .79 for the first pair of self-sorts to 
.88 for the final pair, also significant at the 
1% level (Table 4). The change for the four 
subjects who described themselves at irregu- 
lar intervals over longer periods of time was 
from a mean of .80 to .88. Of these 26 sub- 
jects, 24 showed steady increases in self- 
consistency. 

Apparently, then, increased consistency of 
self-description and presumably of self con- 
cept is to be anticipated with replication 
of description of self, whether intensive or 
spaced over relatively long time intervals, and 
whether psychotherapy is provided or not. 


Summary and Conclusions 


To determine whether changes in the self 
concept similar to those reported in successful 
Psychotherapy may take place with replica- 
tion of self-description by noncounseled sub- 
jects, repeated Q-sort descriptions of the self 
were obtained from 26 persons. In addition, 
15 of the subjects interpolated self-ideal sort- 
ings within the series of self-sorts, For all 
conditions employed, the same general trends 
were found that have been reported for suc- 
cessful counseling. The self concept tends to 


Table 4 


Increase in Consistency of Self-Description 
with Replication 


Mean correlation 


m 
Group or First Final 
individual sorts sorts 
Intensive self-sorts 7 .88 .98* 
Self and self-ideal 
sorts 15 79 .88* 
Scattered self-sorts 4 .80 ‘88 
Mrs. Oak .50 70 


* Difference significant at 1% level. 


Donald M. Taylor 


become more positive and more consistent, 
and its relationship to the self-ideal becomes 
more positive. In all cases, however, these 
alterations were of smaller magnitude than 
those reported in counseling. 

The data obtained suggest these conclu- 
sions: 

1. Intensive self-introspection without ther- 
apy appears to be accompanied by increased 
positiveness of attitudes toward the self, at 
least for most subjects with initially positive 
self-attitudes. The increment, however, is usu- 
ally significantly smaller than that reported in 
successful counseling cases. d 

2. Repeated description of the self Ew 
self-ideal is usually accompanied by increase 
positive relationship between the two, even 
without psychotherapy. The change is smaller 
than that reported for persons in therapy. 

3. Repeated self-description without coun- 
seling usually is accompanied by increase 
consistency of self concept. TA 

4. Self-introspection by self-descrip ta 
without therapy may be accompanied a 
some of the changes reported in success k 
counseling, which presumably also involve 
rather intensive introspection on self. Use ‘ 
self-descriptive techniques, e.g., the Q son 
while therapy is in progress, may then actu 
ally facilitate some of the alterations 5a! 
to be characteristic of successful counseling: 
These techniques do not appear to produce 
changes of the magnitude reported for PSY 
chotherapy, however. f 

5. Significant increases in positiveness a 
self concept, and in positive relationship i 
tween the self and self-ideal, may be va" 
indexes of improvement wrought by therapy: 
but increased consistency of self concept 5 
achieved so readily by self-description wit 
out counseling that it would seem a dubios 
criterion, especially when self-inventories © 
Q sorts are used in conjunction with therapy 
for evaluation or other purposes. 


Received September 20, 1954. 
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Self-Evaluations, Group Evaluations, and 
Objective Measures’ 


Wilse B. Webb 


U. S. Naval School of Aviation Medicine 2 


In a previous paper, it was noted that at 
least three selves could be conceptualized. 
These were: “(a) The objective self, defined 
in terms of his actual potentialities, capaci- 
ties, and the like, i.e., the objectively meas- 
ured self; (b) The self concept, the indi- 
vidual’s understanding or evaluation of these 
potentialities and Capacities; (c) The social 
self, the operation of the potentialities and ca- 
Pacities in relation to his social environment” 
(1, p. 307). This previous paper further 
noted that “It may be assumed that the 
three levels would be related, but disparity 
would be possible between all three levels. 
Unfortunately . . , direct comparison of the 
self levels from our present data are [sic] 
not possible” (1, p, 307). 

The present Paper concerns itself with these 
interrelationships between the three selves de- 
scribed above, Specifically, measures were ob- 
tained as estimates of these three selves and 
the interrelationships are reported and dis- 
cussed. 

Procedure 

Four sections of Naval Aviation Cadets 
with N’s of 29, 24, 20, and 22 were the sub- 
jects of this experiment. Ratings were ob- 
tained from these subjects after they had 
been members of their section for 4 weeks 
and 15 weeks. During this time, each mem- 
ber of each section had had constant and 
close contact with every other member of his 
section. They had lived, worked, slept, and 
eaten together almost daily. 


1 This study was performed as part of ONR Con- 
tract NR 154-098. 


? Opinions or conclusions contained in this paper 


are those of the author. They are not to be con- - 


strued as necessarily reflecting the view or the en- 
dorsement of the Navy Department, 


The traits on which ratings were obtained 


at these periods were defined on each rating 4 


scale as follows: 


Leadership: Could take over and get others r e 
along with him, could direct a group in accomplis 
ing a goal, could act as a leader. A 

Social adequacy’ Ability to get along with me 
people; friendly; liked by the members of his gro T 

Intelligence: A “bright guy”; original; eer 
meet new situations effectively; catches on quickly; 
can use his head; insightful. 

Possibility of success in flight training program. 

Possibility of success as a Naval Aviator. 


For each trait a rating from one to ne 
was possible with the extremes labeled a 
“least” and “most.” The cadets were rf 
structed to “normalize” their ratings, thata 
they were told to rate the relative stan E 
of their own group rather than rating ee 
a general population. As such, they were ao 
that they should give about as many low "4 
ings as high ratings. p Ai 

Each member of the section was given 
booklet of rating scales which were number 
from 1 through the number in his pectin 
The cadet was also given a roster of his ae 
tion in which the names had been assigned E 
a random order to numbers 1 through N. a E 
cadet was told to look at the number on f 5 
rating form, to look at the name appa a 
by this number on the roster, and to proe 
to rate that person on the five traits of t J 
scale. He also was told that one of the mg : 
bers would appear by his own name. He ae 
to rate himself on these traits and to circ 
that number on his rating scale. jS: 

At the completion of the ratings in the 1 
week session, the Otis Quick-Scoring Menta 
Abilities Test (Form Am) was administere 
to each group. 
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Self-Evaluations, Group Evaluations, and Objective Measures 


Results 


In this paper we have concerned ourselves 
oo only one of the traits of the rating scale, 
: intelligence. The correlations between 
ae nee measures of intelligence obtained at 

-week session were: 


Group rating and self-rating 43 
Group rating and Otis 49 
Self-rating and Otis 21 


Era Stoup rating was the mean of all of the 
th gs &lven to an individual by his peers; 
he Self-rating was that rating which the in- 
vidual assigned to himself; the Otis rating 
Was his score obtained on the Otis test of in- 
telligence, ; 
In addition, it was found that the correla- 
tions between the ratings obtained at the 
hog session and at the 15-week session 
e; 


Group rating (4 week) and group rating . 


(15 week) 76 
Self-rating (4 week) and self-rating (15 
Week) 19 


An analysis of variance estimate of the reli- 
ability of the group ratings was .86 at the 
4-week session and .89 at the 15-week session. 


Discussion 


In regard to the group ratings, it is quite 
Clear that the magnitude of these correlations 
1s dependent primarily upon the number of 
Judgments obtained rather than some such 
factor as the “objectivity” of the rater. It is 
to be noted that if only one judge was being 
Used, in contrast to approximately 25 judges 
in each group, correlations of the order 0 
those obtained on the self-ratings would ee 

een expected. These correlations could be 
estimated by considering each ie ear an 
item, and inverting the Spearman-Brown ai 
mula and estimating the reliability of a al 
one-twenty-fifth as long as that used. me r : 
Sultant reliability would be about ol. Tai 
arly, one could estimate the validity 7 he 
8toup ratings using one-twenty-fifth © 
Judges by applying the formula: 
Estimated Teriterion = = Saas reliability 
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In this formula, .04 would be used for the n. 
In this case, the correlation between single 
ratings of a group member and intelligence 
would be about .18. 

Further, it is possible to surmise that the 
low reliabilities and perhaps the low validity 
of the self-ratings were related to this factor 
of “test length.” The demonstrated reliability 
of personality inventories (which involve self- 
evaluation but also involve a large number 
of items) in comparison to the presently ob- 
tained reliability of .19 would support such a 
hypothesis. Certainly, some such hypothesis 
is preferable to the assumption that the in- 
dividual’s “self concept” is as unstable as the 
data may suggest. 

With these considerations the reported cor- 
relations lend themselves to the following in- 
terpretations. To the extent to which the “so- 
cial self” may be conceived of as the com- 
bined group judgments of an individual by 
his peers, this self showed a substantial rela- 
tionship to an objectively measured self on 
the dimension of intelligence. Further, to the 
extent to which a self-statement may be con- 
sidered related to the “self concept” a re- 
markably low relationship exists between this 
self and an objective measure of the trait in 
question. 

We must, however, point to the limitations 
inherent in these statements. In a sense the 
measure of the social self is a statistical arti- 
fact. The quite discrete individual judgments 
of the group members are not summed and 
averaged except perhaps within each indi- 
vidual as he responds to these separate judg- 
ments of Ais peers. Only in voting behavior 
where opinions are summed do we have a 
case in which group judgments are actually 
summed. As for the single rating reflecting 
the “self concept” we have noted that if we 
consider this self concept to be a fairly stable 
state the method here did not show such a 
stability. Perhaps to get a true picture of the 
self concept we must obtain successive judg- 
ments or multiple judgments related to the 
trait in question (similar to the personality 
inventory). 

A still further limitation should be noted. 
We have limited ourselves to peer judgments. 
These ratings, placed in the matrix of the 
total social group of an individual composed 
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of not only peers but superiors and inferiors, 
may reflect quite a different picture. It is 
quite likely that the actual “selves” of an in- 
dividual are markedly affected by the varying 
portions of superiors, peers, and inferiors in 
his operating environment. 


Summary and Conclusions 


Four groups of Naval Aviation Cadets who 
had lived together for 15 weeks rated each 
other and themselves on a number of traits 
including intelligence. The Otis test of in- 
telligence was then administered to these 
individuals. Interrelationships between these 
measures and ratings obtained after 4 weeks 
were computed. It was found that the aver- 
aged group ratings were reliable and corre- 
lated substantially with the objective meas- 
ures of intelligence. The self-ratings appeared 
to be highly unreliable and exhibited only a 
limited relation to intelligence. It was noted 
that the reliability and possibly the validity 
of these relationships were considerably de- 
pendent upon the number of judgments ob- 
tained. That is, the group ratings were an 
average of individual ratings which were no 
more reliable than the self-rating. It was fur- 
ther noted that the group ratings were a sta- 


Wilse B. Webb 


tistical phenomenon and not an actual thing. 
Further, it was noted that our findings were 
within a peer context and the effect of pres- 
ence of superiors and inferiors on these rat- 
ings was not known. In spite of these limi- 
tations, and there are probably others, two 
empirical facts could be stated: f 

1. A group of peers can fairly well “clas- 
sify” its members on intelligence. The way a 
person performs in relation to his peers 1e- 
sults in a reliable and valid “social self” in 
regard to intelligence if this social self can be 
defined as the summation of the group’s atti- 
tude toward the person. 

2. An individual’s single statement about 
his intelligence is likely to have little rele 
tionship to his measured intelligence at er 
time in a group of peers. Stated otherwise, 1 
a self-statement is related to the “self Pi 
cept” of intelligence this self concept 1S likey) 
to be highly unrealistic in relation to objec 
tive measures. 


Received September 21, 1954. 
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MMPI Validity Scores as a Function 
of Increasing Levels of Anxiety 


Joseph D. Matarazzo 
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In an earlier study it was noted, “Our work 
with the Taylor (anxiety) scale has led us to 
wonder if the individuals in the low anxiety 
group (our group I) are not in fact equal in 
anxiety level to the Ss in the high anxiety 
groups but are denying (by their answers to 
the Taylor) this anxiety. That is, they might 
be equal in level of anxiety to the other 
&roups but are repressing or suppressing this 
fact” (9). However, the finding that low anx- 
ious and high anxious Ss earned different 
learning scores (trials) in a maze learning 
task suggested that. the two groups might 
truly be different and that denial was not 
Operating in the low group. 
_ The present study represents an attempt to 
investigate this question further. The Taylor 
Scale of Manifest Anxiety (13) is a ques- 
tionnaire-type inventory, derived from the 
MMPI, containing 50 critical items which 
constitute the anxiety scale and 175 filler 
items. Fortunately, for our purposes, these 
175 filler items contain the three validity 
scales, L, F, and K, of the MMPI (3), which 
are described in more detail below. The aim 
of the present study was to determine the 
strength of the relationship between scores on 
these three validity scales and level of anx- 
lety as judged from the individual’s score 0n 
the Taylor scale. 


Procedure 


The Ss used in the first part of the study 
were 119 male medical freshmen and sopho- 
mores who had served in an earlier study 
(11). On the basis of their Taylor raw scores 
the 119 medical students were assigned to five 
groups on a scale of increasing anxiety level. 
Individuals with raw scores of 1-5 were given 


an anxiety rating of 1, while those with raw 
scores of 6-10, 11-15, etc. were given ratings 
of 2, 3, 4, and 5, respectively. The number of 
Ss in each of these five groups from low to 
high was 18, 41, 34, 15, and 11, respectively. 
The findings with this group were cross vali- 
dated the following year with a group of 31 
female occupational therapy (O.T.) juniors. 
The Taylor scale was group administered in 


both samples. 
Results 


In Fig. 1 is shown the relationship for the 
medical students between the Z score and 
anxiety level as measured by the Taylor 
scale. The strength of this relationship is a 
moderately negative one; the value of the 
Pearson r is — 32, a value significant at the 
01 level of confidence. Values of eta and 


L-SCALE 
N W D oO 


2 3 4 
ANXIETY LEVEL 


Fig. 1. Mean Lie-scale (Z) score for each of the 
five groups ranging from low anxiety (group 1) to 
high anxiety (group 5). 
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Fig. 2. Mean F-scale score for each of the five 
groups ranging from low anxiety (group 1) to high 
anxiety (group 5). 


epsilon, computed from the analysis of vari- 
ance data, yield similar results, .36 and 32, 
Tespectively. Subjects in group 1 earn a Lie 
score mean of approximately 5.00 while those 
in group 5 earn a mean of 3.00. Thus there is 
a moderate tendency for those Ss scoring low 
on the Taylor scale to be less candid (as in- 
ferred from their Score on the L scale) than 
individuals in the higher anxiety ranges. This 
relationship was even more striking with the 
O.T. sample. The value of 7 was found to be 
— .52 with this female sample. The means 


ranged from 5.71 in group 1 to 2.40 in 
group 5. 


dents is shown in Fig. 
this relationship, Significant at the .01 level, 
is greater than that of L, as seen from the + 
value of .46 (eta of .50 and epsilon of 46), 
The means vary from 3.72 in group 1 to 
10.73 in group 5. Again this relationship 
tends to be stronger in the OT: sample 
(r of .62 and approximately similar mean 
values). From these findings it can be con- 
cluded that there is a moderate tendency for 


1 Two of the 64 items of the F scale were appar- 
ently not included in the Taylor scale but this is 
considered relatively negligible for our purposes. Also 
there is an overlap of three items between the Taylor 
and the F scale. This indicates that the obtained r 
‘between these two measures is slightly greater than 
if this overlap did not exist. 
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whatever it is that is measured by the F scale 
to be correlated with the Taylor index of 
anxiety level. : } 

In Fig. 3 is shown the relationship, again 
for the medical students, between anxiety 
level and score on the K scale. The magni- 
tude of the correlation, r of — .71 (eta of 69 
and epsilon of .71), indicates a very high re- 
lationship (.01 level) between these two meas- 
ures. The mean values of K vary from a 
proximately 20 in group 1 to 11 in group A 
The correlation is again stronger in the O.T. 
sample: 7 of — .84, and means ranging from 
22 to 10. This very high relationship between 
the K-scale index and score on the Taylor 
scale would indicate that one’s anxiety leve 
as inferred by his Taylor score reflects r 
“test-taking attitude” as well as whatever els 
it is the Taylor scale is sampling. 


Discussion 


The correlations obtained between the per 
lor questionnaire and each of the three ioe 
lidity scales raise a number of interesi 
questions. The interpretation of these corr 4 
lations would be less complicated if the m 
validity indices represented “independen 
measures and were not themselves compo gs 
of items from the 550-item MMPI. We a 
faced here with the problem of rag pe T 
correlations between two scales (the Tay! = 
and each of the three validity scales) whe 
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1 2 3 4 5 
ANXIETY LEVEL 
Fig. 3. Mean K-scale score for each of the five 


groups ranging from low anxiety (group 1) to high 
anxiety (group 5). 


MMPI Validity Scores and Levels of Anxiety 


eae oe scales are composed of “per- 
a cae questionnaire-type items 
GE ‘this ae e population of items. A way out 
hakit raa 1s to pay less attention to 
es ad A t ese scales are purported to meas- 
sae think in terms of the operational 
ae S involved in their original develop- 
and standardization. 


T 
; eee scale consists of 50 items, chosen out 
Nicians shoy Se MMPI items, upon which 5 cli- 
Were indicatiy, 80 per cent agreement that these 
describeq a of manifest anxiety as the latter was 
four years yY Cameron. The literature of the past 
Sociated vp tes that scores on this scale are as- 
ing ability differences in conditioning and learn- 
intelligence as demonstrated in numerous studies (8), 
also that a measured by a timed test (10), and 
ciently, mi ae scores can differentiate, fairly effi- 
Lie seale Crit! from psychiatric patients (12). The 
ing sort: ] ) is composed of 15 items of the follow- 
at times Would rather win than lose in a game; 
es I feel like swearing; I do not always tell 
; 2 gossip at times; etc. The authors of 
s ound empirically that a large, repre- 
are Sample of “normals” will usually answer 
up ‘hie these and the other similar items making 
and canes ale. The F scale was similarly developed 
infrequ sists of 64 items which are answered in the 
fine ee direction less than 10 per cent of the 
the F Y these same “normals.” A subject's score on 
functi, Scale (3) has been found empirically to be a 
to co: on of carelessness in taking the test, inability 
an; omprehend the items, errors in recording on the 
Swer sheet, the presence of psychiatric illness (1, 
ae extreme individuality (in the sense that 1 
REN Up those few people who are highly individu 
which Pendent and who honestly score those items 
are infrequently scored by “normals”). The 
River” a 30-item scale purported to assess dita 
tud ess or lack of it in a subject’s “test-taking atti- 
res © was empirically derived by studying the ea 
Gin frequencies of certain diagnosed abnormals 
lees MMPI pattern yielded essentially normal Uae 
oc S. It was assumed by the MMPI authors than 
See of a normal profile in a known psychl- 
ric patient was suggestive of a defensive attitude in 
'S Patient’s response behavior. The response fre- 
quencies of these “normal appearing” patients en 
ontrasted with those from an unselected sample © 
People in general (“true normals”). The items whic 
nctentiated these two groups were then scored sO 
ate a high K score would be found among Saw 
wore with normal curves, whereas a low oe 
ae be found in clinical normals having aro 
by inn The authors then identify the trait Beer 
sens © K scale by suggesting that, in this open ee 
of ©; it can be said that a high score is in beet 
un à defensive attitude, and a low K score sugg 
“sual frankness or self-criticalness (7)- f 
ie authors of the MMPI consider all three 0: 
ese scales in two ways: (a) as validating scales, 
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the scores of which will help the clinician determine 
for any subject whether or not his responses were 
unduly influenced by his test-taking attitude, and 
(b) as an index of certain aspects of his personality, 
ie., if he rejects by his test responses all those items 
that imply personal faults or personality difficulty 
then this very rejection (reflected in the validity- 
scale scores) tells us something about the kind of 


person he is (3, p. 23). 

It is in regard to the second interpretation 
of the validity scales that the results of the 
present study are pertinent. The correlations 
obtained between the Taylor scale and each 
of these three measures serve the purpose of 
bringing together two separate streams of re- 
search—studies growing out of ‘hypotheses 
based on learning theory and clinical experi- 
ence (Taylor scale) are thus related to the 
many personality theory studies which have 
grown out of the parent instrument, the 
MMPI.? If one brings together the results of 
these two independent streams of research, it 
would appear that Ss who score low on the 
Taylor scale and who have been shown to be 
superior in learning ability (to Ss whose anx- 
iety level is higher) on some tasks, and to be 
inferior on still others, and who earn higher 
scores on the ACE test of intelligence, etc., 
are also individuals who are not as frank and 
are probably more defensive in their test-tak- 
ing behavior. Individuals who score in the 
middle range or at the high end on the Taylor 
scale can be similarly understood as progres- 
sively less defensive. Thus, in the sense of the 
second usage of the validity scales, the cor- 
relations obtained in this study enable us to 
know more about the characteristics of an in- 
dividual subject than would be possible from 
knowledge of his Taylor score or his scores 
on the validity scales alone. The implications 
for the Taylor scale, and studies based on 
it, of these findings (especially the lack of 
“frankness” in the low “anxious” groups) 
will become clear only after further research. 

These data would suggest, however, that 
the superiority of the high anxious group 
(Taylor scale) in numerous conditioning 

2Tt is of interest to recall that the Taylor scale 
represents items which clinicians judged indicative of 
manifest anxiety, while the three validity scales are 
composed of items which empirically have separated 
groups (patients from “normals,” malingerers from 
nonmalingerers, ete.) and in which clinical judgment 
played no a priori role, 
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studies reported to date is as much a func- 
tion of their “lack of defensiveness” in test- 
taking attitude as it is a function of their 
anxiety level. The performance of the middle 
and low anxious groups can be similarly in- 
terpreted. In this connection it is of interest 
that Baron * has found a “striking curvilinear 
relationship” between the MMPI K score 
and verbal learning. The high correlation 
found between K and anxiety scores would 
thus indicate that Baron’s results confirm our 
earlier finding of a significant curvilinear re- 
lationship between anxiety score and stylus 
maze learning (9). The significant correla- 
tions found in the present study raise some 
other interesting questions: Is the Taylor 
scale a measure of “anxiety,” or is it a meas- 
ure of “defensiveness,” or lack of “candid- 
ness”? Are the K and L and F scales also a 
measure of anxiety? Or is it possible that all 
four scales are tapping a common factor, a 
factor we might tentatively call “level of mal- 
adjustment.” Further research will be needed 
to answer these questions, although it is of 
interest that the Taylor scale (as well as the 
validity scales) can differentiate, reasonably 
efficiently, a psychiatric from a nonpsychi- 
atric patient sample (12). 

The findings of the present study are also 
of interest for the MMPI user. The grand 
mean values for all 119 medical student Ss of 
this study (independent of Taylor anxiety 
level) on the L, F, and K scales were < yA A 
5.17, and 16.87, respectively. These are mean 
values which are clearly in the established 
limits considered “normal,” since raw scores 
of 7, 17, and 23, respectively, are necessary 
to earn a T score of 70 or above. The curves 
shown in Fig. 1, 2, and 3 therefore represent 
a finer analysis of validity scores (heretofore 
considered “normal”) along a dimension of 
anxiety. Thus the correlations permit a re- 
finement of the “meaning” of the validity 
scores. 

The question can be raised whether the 
demonstrated relationships between the items 
making up the validity scales and those mak- 
ing up the Taylor scale are exact ones since 
the three validity scales, imbedded in the 


3 Baron, M. R. Personal communication, October 
1953. Professor Baron also found a high 7 between 
K and ansiety. 
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225-item Taylor questionnaire, might be re- 
sponded to differently than if the full 550- 
item MMPI were administered. While this 
question must be left open, as it was not spe 
cifically investigated in this study, it is felt 
that the effect on the demonstrated correla- 
tions, if any, would not be serious. 


The results of several recent publications are ah 
of interest in relation to our findings. Heineman va 
working in the Iowa laboratory where the Ter 
scale was developed, set out specifically to deve a 
a forced-choice form of the Taylor inventory 1M 0 $ 
der to reduce the effects of the desire of Ss to SB 
pear in a favorable light and so earn by their r 
sponses lower Taylor anxiety scores. His study ne 
prompted by several findings at Iowa, one of beo 
was a heretofore unpublished correlation of A ie 
between the anxiety scale and the K scale of ns 
MMPI. The latter is comparable to the correla 
found in the present study. By use of his for i 
choice technique, Heineman was able to reduce i! 
correlation between Taylor score and K to app” oa 
mately —.55 when he scored his new scale HRS 
way and — .40 when he scored it by a secont -n 
In his review of the Taylor scale, Mandler (8) In 
ports two studies from the Harvard laboratory: E 
the first place, Ericksen found a correlation of. oe 
tween psychasthenia-hysteria (MMPI hysteria a 
minus psychasthenia score) and the Taylor, 
high anxiety scores related with psychastheni®. if 
the second, Ericksen and Davids report a rank ae 
correlation of .92 between the MMPI psychast! ro 
scale and the Taylor score, and a rank-order Ree 
— .89 with the hysteria-psychasthenia measure. °° 
authors also report an interesting correlation of Tk 3 
between the Taylor scale and rankings on the the 
of “optimism-pessimism.” They suggest that oD 
basis of clinical appraisal, high and low Sones 
on the Taylor scale also show differential defe is 
mechanisms and self-attitudes. This suggestion ie 
clearly similar to the finding which prompted sy- 
own study. Hovey, in a clinical study using Ee 
chiatric patients, found that his 60 Ss who we 
diagnosed “anxiety reaction” earned the lowest S 
on the K scale and the highest on the F saa Ss 
These patients thus were similar to the “norma” 7 
in our high anxiety group, group 5, who also ok 
lowest on the K scale and highest on the F sine 
Deese, Lazarus, and Keenan (2) report a ouan 
tion of .81 (reduced to .40 when overlapping [MPI 
were excluded) between the Taylor and the M that 
psychasthenia scale. All of these studies suggest veen 
there are many interesting relationships bet dte 
these MMPI clinical scales and anxiety as reflecte 
in the Taylor score (or diagnosed clinically, 25 
the study by Hovey). 


, e 

One further point is worth noting. ue 
scores of research papers utilizing the Taylo 
scale published since this crude index of an*- 


A 


> 


> 


MMPI Validity Scores and Levels of Anxiety 


aS introduced in 1951 are an indication 
ae i lea with which psychological sci- 
alia ona a reliable, and, on the face, 
<a a of anxiety. The high correlations 
faa A me -84) obtained in this study be- 
that fant aylor and K scale would indicate 
Brit of ae may be used as an alternate 
sideratio e Taylor (with appropriate con- 
aaah of the negative direction of the 
BF the ion) in research requiring two forms 
aka 9 These correlations between K 
the try aylor scale are not much lower than 

i at teliability coefficients of the latter 

The t -89) reported by Taylor (13). 
Oiio end for the all-female O.T. sample 
er y consistently higher correlations be- 
validi e Taylor scale and each of the three 
( idity scales, as compared to the all-male 
a bly more intelligent) medical student 
i Ple, is difficult to interpret. Further re- 

arch may offer an hypothesis to explain this 
observation. 


Summary 


The Taylor anxiety scores of 119 male 
medical students were correlated with their 
Scores on the three validity scales (L, F, and 
K) of the MMPI. The obtained correlations 
Were — 32, 46, and —.71, respectively. 
These values were all significant at the .01 
level of confidence. These findings were cross 
validated on a sample of 31 female occupa- 
tional therapy students. There was a con- 
Sistent trend for all correlations to be higher 
in this second sample. It was suggested that 
these correlations serve the purpose of bring- 
ing together two heretofore separate streams 
Of research—Taylor scale studies growing out 
Of hypotheses based on learning theory and 
clinical experience, on the one hand, and per- 
Sonality theory studies which have grow? out 
Of the parent instrument, the MMPI, on ae 
Other, Questions regarding the interpretation 
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of what each of these scales “taps” were 
raised. 


Received October 11, 1954. 
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The Relationship of Manifest Anxiety to Wechsler- 
Bellevue Subtest Performance’ 


Ruth G. Matarazzo 
Washington University School of Medicine 


Since the Taylor scale is an objective and 
apparently valid measure of anxiety, it seemed 
that here was a way, free of the usual haz- 
ards of subjectivity and bias, for selecting 
groups on which to test some common clinical 
assumptions about the subtest pattern of the 
Wechsler-Bellevue to be expected as a result 
of anxiety. 

Wechsler does not report the characteristics 
or size of his neurotic group but, apparently 
on the basis of clinical impression, describes 
it as tending to be particularly low on the 
Digit Span and Object Assembly subtests. In 
their two volumes Rapaport, Gill, and Schafer 
reported a similar pattern based, however, on 
an Anxiety and Depression group consisting 
of only ten patients. 

The subjects for the present study were 80 
medical and psychiatric hospitalized, white, 
male patients between the ages of 18 and 37. 
The subjects were administered the Wechsler- 
Bellevue and asked individually to fill out 
the Taylor scale. Raw scores on the Taylor 
scale were coded into five anxiety groups, 
Taylor scores from 1 to 8 receiving an anx- 
iety rating of one, those from 9 to 16 a rat- 
ing of two, and so on. The number of subjects 
within each group from 1 to 5 were 7, 17, 16, 
21, and 19, respectively. F tests indicated 
that the groups were equated for age, educa- 


1An extended report of this study may be ob- 
tained without charge from Ruth G. Matarazzo, 
Dept. of Neuropsychiatry, Washington University 
School of Medicine, St. Louis, Mo., or for a fee 
from the American Documentation Institute. To ob- 
tain it from the latter source, order Document No. 
4523 from ADI Auxiliary Publication Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.75 for micro- 
film or $2.50 for photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. 


tion, and IQ, the mean age being 29, mean 
education 10th grade, and mean IQ 105. 

By means of the F test the performance of 
the five groups was compared on each of the 
eleven subtests of the Wechsler-Bellevue and 
no relationship was found between anxiety 
level and subtest performance. The use of a 
correlational technique (epsilon) confirmed 
this lack of relationship; no one of the eleven 
epsilon values reached significance. ; 

Since the group means might be obscuring 
true differential patterning effects or “ten 
among the various subtests for individua 
patients, two measures of individual scatter 
analysis were used: (a) range; and (b) pe 
viation from the mean (a count was made 0 
the number of subtests which differed by three 
or more weighted score units from the indi- 
vidual’s mean weighted subtest score). Neither 
of these two measures bore a relationship tO 
anxiety level. f 

Comparing the upper and lower 20% © 
the anxiety continuum, as has been done 
most studies with the Taylor ,scale, did not 
change the negative results, Eliminating sub- 
jects with IQ less than 100 also produced n0 
change. 

Assuming that the Taylor scale measures 
the same thing which clinicians mean bene 
they speak of anxiety, the present results nag 
lead us to carefully question the validity ° 
the diagnostic signs described by Wechsler, 
Rapaport, and others. The present results are 
perhaps surprising in view of the long et 
widely held belief among clinicians that an 
span especially, and perhaps object assembly 
to a less extent, are vulnerable to anxiety- 
Brief Report 
Received December 21, 1954. 
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The Relation of Manifest Anxiety to Association 
Productivity and Intellectual Attainment’ 


Anthony Davids and Charles W. Eriksen 


Harvard University 


a Hull's theoretical system all habit 
consider les activated by a given stimulus are 
en red to be multiplied by the total drive 
Stee ng, This proposition has been 
tests - to a number of recent experimental 
a pers Popular technique has been to employ 
oc. ee scale of manifest anxiety (8) to 
Perform a measure of total drive gene 
high o j. nce of Ss selected on the basis 0 
Pared r low scores on this scale has been com- 
(2, 5 on such measures as eyelid conditioning 
varion 6, 7), verbal learning (3, 4, 9), and 
n us other more complex tasks (1, 10, 11). 
Dte eral, the results have tended to support 
ictions derived from Hullian theory. 

w his theoretical formulation holds two some- 
ie related predictions for performance 
asures, The higher the total drive state, 
H more likely is the occurrence of the strong- 

t response tendency, but, also, with high 
rive states, the greater is the total number 
one tendencies that are ti te 

e studi eyelid conditioning 2a 

east a a the effect of drive 
yl upon a single dominant response, and 
© verbal learning studies have indirectly 
Confirmed the related prediction that with 
igh drive a greater number of response 
tendencies would be above threshold. In these 
atter studies the support has been indirect 
Since it has come from the deduction that 
'gh drive leads to a greater number of oie 
lead responses which, in turn, ditteren aa 
interfere with learning depending upon the 
This investigati facilitated_by „research 
Brants fee ie aed Laboratory. of Se ron 


tions, th ion, and 
» the Rockefeller Foundation, 
Institute of Mental Health (Grant M-700), Public 


degree of learning (relative strength of the 
correct response) that has occurred. 

It was our first purpose in the present ex- 
periment to provide a more direct test of the 
deduction that a high drive level would lead 
to a greater number of responses being supra- 
threshold. From this deduction, it would be 
expected that scores on the manifest anxiety 
scale would be directly related to the number 
of associations given in response to stimulus 
words on a chained word association test. 

A second purpose in this study was to in- 
vestigate relations between scores on the anx- 
iety scale and two measures of intellectual 
ability. Although it is common practice to 
select subjects from a college population on 
the basis of their anxiety scores and to com- 
pare the learning rate of “anxious” and “non- 
anxious” groups, the question of whether this 
selection procedure introduces ability or in- 
tellectual differences is as yet unanswered. 
In the attempt to secure evidence bearing 
upon this question, we correlated results on 
the anxiety scale with performance on a bat- 
tery of college aptitude tests and with aca- 
demic achievement. 


Method 


Subjects. Forty male undergraduates par- 
ticipated in this study. They were selected 
from among a larger number of students who 
had volunteered to serve in an extensive series 
of psychological studies. Their selection was 
on the basis that the group include as much 
diversification as possible, within the limits 


? It should not be overlooked that an unambiguous 
answer to this question may be difficult, or impos- 
sible, to attain since anxiety could conceivably affect 
performance on “ability” or “intelligence” tests. 
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of a college population, in regard to socio- 
economic status, interests, abilities, and extra- 
curricular activities. 

Word association test. This test consisted 
of a list of 100 nouns, selected as representa- 
tive of a wide variety of attitudes, beliefs, and 
personality traits. Ten of the words were de- 
signed to relate to anxiety or fear. The words 
were presented to Ss by means of a tape re- 
corder. The Ss were supplied with numbered 
data sheets and were instructed to write down 
as many associations as possible to each of 
the 100 stimulus words. The words were 
played one at a time from the tape recorder, 
and 20 seconds were allowed after each word 
for Ss’ chained associations. 

Administration of the manifest anxiety 
scale. In a session following the word associa- 
tion test, Ss were individually administered 
the anxiety scale. The items selected by Tay- 
lor (8) were interspersed among the items 
from the hysteria, psychasthenia, lie, and K 
scales of the MMPI. Scores on the anxiety 
scale for the 40 Ss in our sample ranged from 
2 to 41 with a median of 17. 

Measures of scholastic ability. Transcripts 
of Ss’ academic records were secured from the 
registrar’s office, and they were rank ordered 
in terms of their grade-point average. Let- 
ter grades, with plusses and minuses taken 
into account, were transformed to numerical 
equivalents employing a scoring scheme that 
ranged from 1 to 12, with “A” equal to 1 and 
“E” equal to 12. Grade-point averages for the 
40 Ss ranged from 1 (A) to 8 (C—), with 
a median of 5 (B —), indicating considerable 
diversity in academic achievement. A separate 
rank order was determined on the basis of Ss’ 
performance on the college entrance examina- 
tions. Here again pronounced variability was 
evident, with scores ranging from 474 to 730 
and a median of 611. 


Results and Discussion 


Table 1 contains correlations between scores 
on the anxiety scale and several measures 
of performance on the word association test. 
The coefficients in the first row are based 
upon the entire series of 100 stimulus words, 
while the coefficients in the second row are 
based only upon responses to the 90 nonanx- 
iety stimulus words. In the first column of 
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Table 1 


Product-Moment Correlations Between Manifest 
Anxiety Scores and Word Association 
Test Performance 


(N = 40) 
Percent- 
Number Number age of 
of asso- ofanxiety anxiety 
Measure ciations responses responses 
100 Stimulus words h a .54** .34* 
90 Nonanxiety 4 
stimulus words .40** 42** 135 


* Significant beyond the .05 level. 
** Significant beyond the .01 level. 


this table, it can be seen that scores on the 
anxiety scale are directly related to produc- 
tivity of associations. Whether or not the 10 
anxiety stimulus words are included in the 
computations, high anxiety scores are Cor- 
related positively with a high number of as- 
sociations. These relationships are significant 
beyond the .01 level. 

The magnitude of the differences in number 
of associations can be seen when a compari- 
son is made between the means obtained by 
the 20 highest Ss and 20 lowest Ss on the 
anxiety scale. The mean number of paa 
tions given by the high group was 530 an 
the mean number given by the low group was 
454. Comparison of the difference between 
these means results in a ¢ of 3.21 which is 
significant beyond the .001 level for a onsi 
tailed test. These findings are in keeping with 
the expectation that high drive level, as meas- 
ured by the anxiety scale, increases the num- 
ber of responses that are above threshold. 

While our major concern was whether p 
anxiety scale would relate to productivity 0 
associations, the present data afford an Op- 
portunity to examine the relation beta 
anxiety measured by the Taylor scale an 
anxiety assessed by the word association tech- 
nique. Since the Taylor scale contains.a large 
number of items concerning subjective feel- 
ings of anxiety, it seems plausible to expect 
that Ss scoring high on this inventory woul 
evidence a relatively large amount of verb 
content indicative of anxiety and anxiety 
ideation. To explore this possibility, we com- 
puted the number of associations given bY 


® 


Manifest Anxiety, Productivity, and Achievement 


ee at referred to anxiety ideation.* The 
show the s in the second column of Table 1 
Pi degree of correlation between anx- 
feo. and number of anxiety responses 
ae from the different Ss. Again relations 
whether o beyond the .01 level are obtained 
are în a or not the 10 anxiety stimulus words 
high cluded in the computations. The Ss with 
anxi manifest anxiety scores tend to give more 
Ss ety associations than do the low-scoring 
t x his latter finding holds true even when 
for arber of anxiety responses is corrected 
3 of erences in total productivity. In column 
ab able 1 the number of anxiety responses 
divid reo expressed as a percentage of the in- 
aoe S total number of responses, and the 
level ee correlations remain above the 05 
ti of statistical significance. As an addi- 
Onal control for the influence of total pro- 
ved on the relation between the manifest 
c lety scale and anxiety associations, partial 
Orrelations were computed between these two 
p ires of anxiety, with the total number of 
a ations held constant. In response to the 
Aa ite word association test and the 90 non 
ti xiety stimulus words, the partial correa- 
ion coefficients are significant at the .05 level 
6 and .31), providing clear-cut evidence 

a positive relation between these two di- 
verse approaches to the measurement of 
anxiety, 
The second purpose in this study was to 
€termine whether the relations that have 
een reported between the Taylor anxiety 
Scale and various performance measures mat 
Not have been due in part to a correlation a 
this scale with intelligence. With measures o. 


Scholasti P hievement as indices 
stic aptitude and achie 
p e entrance €x- 


of intell ic 
ectual capacity, colege § 
amination scores and grade- oint aveai 
Were correlated with scores ee ee yr 
au t anxiety SCO 
E aminations an 
i Thus, 1 
‘l7 with grade-point ý 
neither case did the coefficient, 
tistical significance. These tw! Bea 
intellectual ability were also cor sae 
Word association test productivity and, ‘ 


ement betwee! 
f coe anxiety response: 


n two inde- 


3 The percentage 0 s for 20 


Pendent raters’ scoring ° 
Ss was 91. 
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there was no evidence of significant relation- 
ships. 

This failure to obtain relationships even ap- 
proaching significance between results on the 
anxiety scale and measures of intellectual 
ability strongly suggests that scores on the 
scale are largely independent of intelligence. 
Of course, it must be realized that these cor- 
relations were obtained on the basis of re- 
sults secured from an intellectually homo- 
geneous population. And it should not be 
overlooked that if the sample contained a 
representative proportion of the general popu- 
lation a significant relation between anxiety 
score and intelligence might be demonstrated. 
But, in this regard, it is important to note 
that most of the findings reported with the 
anxiety scale have been obtained with col- 
lege students similar to those employed in the 
present study. Therefore, it would seem safe 
to conclude that the demonstrated differences 
in performance between Ss who score high 
and low on this scale of manifest anxiety are 
probably not attributable to differences in 
intellectual ability. 

Summary 

In the present study, scores on the Taylor 
scale of manifest anxiety were correlated with 
performance on a 100-word chained associa- 
tion test. Supporting the prediction based on 
the supposition that anxiety measures drive, 
significant positive correlations were found 
between anxiety scores and productivity of as- 
sociations. It was also found that Ss scoring 
high on the anxiety inventory tended to give 
relatively more associations containing anx- 
jety ideation than did low-scoring Ss. Cor- 
relation of anxiety scores and association pro- 
ductivity with grade-point averages and per- 
formance on college entrance examinations 
indicated that, in the present sample, both 
anxiety and productivity were independent of 
these measures of intelligence. 


Received March 21, 1955. 
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_ In a recent study which appeared in this 
Journal Matarazzo, Ulett, Guze, and Saslow 
report (1, p. 203), “Therefore it can be con- 
cluded that anxiety appears to be moderately, 
although significantly, correlated with total 

E score and that the higher the anxiety 

level the lower, on the average, is the ob- 
tained score on this test.” They obtained a 

\\, Pearson z of — .25 which with an N of 101 
Nas significant at the 1% level of confidence. 
is finding of course is of considerable im- 
Portance because of the large number of 
a Udies which have recently appeared in the 
iterature in which the Taylor Manifest Anx- 
lety Scale (4 scale) was used to separate 
anxious from nonanxious Ss. If the A scale is 
related to the ACE then the differences on 


N {earning problems, perceptual tasks, etc. ob- 


ained between anxious and nonanxious Ss 


Chosen on the basis of the A scale may be 
1 rather than anx- 


d we decided 
anti- 


Merely due to intelligence 


‘ety. With these facts in min 
that an attempt should be made to subst 


ate thej i 

yn eir findings. 2 9 
Yur sample originally consten ei a 
ichigan State College students, hae be- 
Student was not included in ouk scan - 

Cause of his extremely low ACE * sco 
significant Te- 
Bike cvs. They 
the fact that 
hile the 


\ 


; l * Matarazzo et al. failed to an 
tionship between the Taylori ie 
attribute this lack of relationshiP ot wi 
the CVS is not a timed intelligence 
ACE is, is not given to a student at 

The raw ACE score 38 ank is assigned. 

Michi e; instead, a T a 

Er ae eae analysis ae used t for the 

Doi ore, in masi Sor each rank ex pe pe 

_ point of the raw scores ° prse, only the lower limit 
ighest rank where, of °° 


Was used. 


A Failure to Replicate the Finding of a Negative 
Correlation Between Manifest Anxiety 
and ACE Scores 


R. E. Schulz and Allen D. Calvin 
Michigan State College 


Following the procedure utilized by Mata- 
razzo e¢ al, we divided our Ss into four 
groups on the basis of their A-scale scores. 
Group I consisted of those Ss with A-scale 
scores from 1-8; Group II, 9-16; Group III, 
17-23, and Group IV, those Ss with A-scale 
scores of 24 and higher. A Pearson 7 was 
computed, and a correlation of .02 was ob- 
tained. This practically zero relationship fails 
to confirm the findings of Matarazzo eż al. 
The present authors felt that a more precise 
estimate might be obtained if the actual A- 
scale scores for each S were utilized instead 
of grouping them into four categories as 
Matarazzo et al. did. We therefore computed 
an r using individual A-scale scores, but 
again we obtained a zero correlation. 

In order to test for rectilinearity an eta was 
computed, and a value of .10 was obtained 
which is also not significantly different from 
zero. A x? test of goodness of fit was made, 
and the resulting x° fell far short of signifi- 
cance indicating a rectilinear relationship.* 
This supports the findings of Matarazzo 
et al. who also report a rectilinear relation- 
ship. 

Why did we find a low positive relation- 
ship which does not differ significantly from 
zero while Matarazzo et al. report that they 
found a significant negative relationship? One 
possibility is that our Ss had a different dis- 
tribution of Taylor scores than theirs. They 
give the following distribution of anxiety 
scores: Group I had 13 Ss, Group II, 47 Ss, 
Group TII, 23 Ss, and Group IV, 18 Ss. Our 


_? Since the r and eta we obtained are both insig- 
nificant, our x? test, of course, is not too meaningful, 
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Ss scored as follows: Group I, 24 Ss, Group 
II, 44 Ss, Group III, 22 Ss, and Group IV, 
8 Ss. A x? was computed, and since it fell 
short of significance (p > 05) the null hy- 
pothesis tends to be confirmed. Another pos- 
sibility is that the difference between their 
findings and ours could be attributed to 
variations in selection procedures which might 
result in a different type of student body at 
the respective institutions. However, until 
more evidence appears to support the results 


R. E. Schulz and Allen D. Calvin 


of Matarazzo et al. it would seem that a 
valid relationship between intelligence and 
scores on the Taylor Manifest Anxiety Scale 
has yet to be established. 
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Influence of Socioeconomic Status on Wechsler 
Intelligence Scale for Children: Addendum 


Betsy Worth Estes 
University of Kentucky r 


The present study is a continuation of “In- 
fluence of Socioeconomic Status on Wechsler 
Intelligence Scale for Children: An Explora- 
tory Study” (1). 

In the previous study there were two groups 
of subjects: one aged 7 years, plus or minus 
2 months, in the second grade (V = 40); the 
Other aged 10 years, plus or minus 2 months, 
i the fifth grade (W = 40). Each group was 
further divided by socioeconomic status into 
two groups, one of upper economic and one 
of lower economic status. Each group had an 
equal number of boys and girls. Mean scores 
On the WISC did not vary with socioeconomic 
level in the fifth grade but did vary in the 
Second grade. In the second graders, the upper 
group exceeded the scores of the lower group 
at the 1 per cent level. Several possible ex- 
Planations for this decrease in the effects of 
Socioeconomic status with increase in age and 
Stade were offered. 

Tn 1953-1954, the previous secon 
Were in the fifth grade; therefore, it was 
cided to retest them. 


cond graders 
de- 


Subjects and Procedure 

Some of the subjects were merim a 
they haq moved out of the state. In the ae 
1951 study there were 20 in the upper ee 
Se es md ne in the 
there were 18 in the upper an TEEN 
Ower, These latter subjects who w 


had shown a sig- 
able for the present EDE study be- 


nificant difference in WISC 
tween the ait and lower a The 
Was administered to each °°" 


Results 


There was an increase in mean IQ score for 
each economic group, but the difference be- 
tween the groups was not statistically signifi- 
cant, as shown in Table 1. The scaled scores 
of the WISC also showed no significant dif- 
ference in the 1953-1954 study. 


Table 1 


WISC Intelligence Quotients of Two ` 
Socioeconomic Groups 


——————————————————————————— 


Socio- 1950-1951 1953-1954 

economic 

group Mean SD t Mean SD t 

Upper 114.50 9.49 119.44 14.59 
3.02** 1.76 

Lower 104.21 9.05 111.93 8.69 


** Significant at less than the 1% level. 


Discussion 


The same result was obtained in the later 
study as in the first one: a decrease in the 
effects of socioeconomic status with increase 
in age and grade. The evidence is strength- 
ened by the demonstration that the same chil- 
dren who differed in the second grade did not 
differ in the fifth grade. 

It must not be overlooked that the means 
of the upper group on both 1Q’s and scaled 
scores are higher than the means of the lower 
group. However, by the fifth grade, they did 
not differ significantly for these subjects. 

The possible explanations offered in the first 
study may still be held: selective factors in 
promotion, the public schools, movies, Sunday 
schools, etc. exerting an increasing effect with 
advancing age and thereby narrowing the dif- 
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ferences between socioeconomic levels, or fac- 
tors within the WISC itself which operate to 
reduce socioeconomic effects with age. 


Summary 


Two groups of subjects, 18 in the upper 
socioeconomic group, 14 in the lower group, 
were retested on the WISC. The significant 
difference between the two groups which was 
found three years earlier when they were in 
the second grade no longer existed. With in- 


Betsy Worth Estes 


crease in age and grade, there was a decrease 
in difference between groups as measured by 


mean IQ and mean scaled scores on the 
WISC. 
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gen study is an outgrowth of research on 
i development and selection of measures 
Ío a battery designed to establish a psycho- 
peal prognosis for schizophrenic patients. 
preliminary report by Zaslow (2), in which 
e described a sorting test used to investi- 
gate disturbances in concept formation in a 
group of schizophrenic subjects, was felt to 
© sufficiently encouraging to warrant fur- 
er investigation. Although a recent article 
eee and Cantor (1) supplied data on 
repa ormal adolescents, to date no study has 
Ported on the reliability of the procedure. 
O this end, an attempt was made in the 
present study to evaluate the test’s reliability 
; pih two populations, as well as to investigate 
S; validity by repeating the test on three 
ample groups. 


Method 


The test consists of 14 geometric designs, 
fach drawn on a white card 2 inches square. 
Che first design is an equilateral triangle with 
Sides of 11% inches; the design on the a 
Card is a true circle with a diameter of 134 
ches, The 12 intermediate cards form i 
Continuum in which the sides of the triangle 


from 
i This research was facilitated by a grant 


Health, Public 


È National itute of Men pas 
meat coming "Departssent ot Heh Rap oni 
Welfare, Project 6C. Ti, hors AT Ta- 


d 

ine yibted to Professor Joseph ice and guidance. 
=) We ator, for his invaluable $ ad Herbert Green- 

i Wish t thel i ting. 
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Zaslow’s Test of Concept Formation: Reliability 
and Validity’ 


Sol Kugelmass 


Psychiatric Institute, Columbia University 


and Marvin R. Foundeur 
Teachers College, Columbia University * 


become increasingly circular and finally ter- 
minate in the true circle of card 14. 


The test was administered individually to three 
groups. The first group consisted of 45 patients in 
the early stages of schizophrenia, 26 females and 19 
males, randomly selected from the admission and 
convalescent wards of the New York State Psychi- 
atric Institute. None of these patients had been in- 
stitutionalized for more than 20 months at the time 
of testing. The mean period of hospitalization was 
4.6 months. Ages ranged from 14 to 55 years, with 
a mean of 25.8 years. The educational level ranged 
from 8 to 20 years with a mean value of 12.5 years. 
All patients included in this group were diagnosed 
as schizophrenics of various types, though the ma- 
jority fell into the paranoid classification. 

The second experimental group was obtained from 
the reception wards of Brooklyn State Hospital. 
They were chosen at random by the psychiatric 
staff from the recently admitted patients who had 
a diagnosis of schizophrenia. Their ages ranged from 
16 to 51 years, with a mean of 31.1 years, Their 
educational level ranged from 6 to 16 years with a 
mean of 10.8 years. The 23 patients in this group 
comprised 13 females and 10 males. 


These two patient populations may be con- 
trasted in the following respects: the Psychi- 
atric Institute patients were all voluntary ad- 
missions, capable of adapting to a permissive 
hospital milieu, of adequately caring for 
themselves, and in general did not pose a 
nursing problem. They were admitted to the 
hospital largely on the basis of their having 
a favorable prognosis. The sample drawn 
from Brooklyn State Hospital is more repre- 
sentative of the admissions usually found in 
a large state hospital. These patients mani- 
fest overtly bizarre behavior and many of 
them pose serious management problems. At 


o 
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least one-third of this group has a history of 
one or more previous hospitalizations for a 
mental disorder. 


A group of 23 college students, 8 females and 15 
males, attending summer session courses at a large 
nearby university were employed as controls. These 
subjects were regarded as normal on the basis of 
their having no clinically manifest neurosis or psy- 
chosis. None were under medical or psychological 
treatment at the time of testing, nor had they ever 
been hospitalized for a mental disorder. 


A test procedure consisting of the follow- 
ing four major parts was employed: 


Part A. The 14 cards are scattered on a table be- 
fore the subject, who is then requested to arrange 
them in one row in the best possible manner. 

Part B. The true triangle and the true circle are 
placed at some distance from each other and the 
subject is requested to arrange the remaining cards 
(which are scattered randomly as in Part A) be- 
tween these two in proper order so as to form a 
continuum from triangularity to circularity. 

Part C. The examiner arranges thé cards correctly 
on the continuum and the subject is requested to 
indicate how many cards belong in the triangle 
group and how many cards belong in the circle 
group. This establishes conceptual boundaries of a 
certain magnitude for these two concepts. 

Part D. The subject is requested to remove all 
cards which are neither triangles nor circles. This 
measures the ability to maintain the previously es- 
tablished conceptual boundaries. 


Results 

In the absence of an 
test, and the ina 
method, the tes 
ployed to deter: 


alternate form of the 
pplicability of the split-half 
t-retest technique was em- 
p mine the dependability of the 
Instrument over various intervening periods 
of time. The Performances of all subjects in- 


cluded in the study were rated on the follow- 
ing parts of the test, 


Part A. There are three Possible levels of perform- 
ance for which scores hay; 


Pairs or pat- 
at all, for p 


cause of its gross susceptibility 
Part B. A perfect score is d when each 
card is placed in its proper sequence along the con- 


Sol Kugelmass and Marvin R. Foundeur 


tinuum. A quantitative performance aoe = of 
tained by calculating the Gee at oair 
expected order of the cards and the o a 
and squaring and summing these ee is the 
Part C. This yields three scores base aay 
Point at which the subject establishes his Po AEE 
boundaries, C* or the card with which tl f ee ine 
establishes the triangle boundary, C° or BE aa the 
boundary of the circle was placed, and MEO, 
number of cards remaining in the interned Ae 
being classified as neither triangles nor ama an 
Part D. This gives a measure of the insta’ gad c, 
interpenetration of boundaries eaeh d and C° 
by determining whether the boundaries ane 
are maintained when the subject is requeste itherd 
move those cards which he considers to De a an 
triangles nor circles. This score is recorde! 
“yes” or “no” entry. 


. ious 

The reliability coefficients for the oa 

portions of the test and for fe eote a ‘a 
which were retested are shown in 


Table 1 


Test-Retest Correlation Coefficients for 
Zaslow Test Scores 


Psychiatric 
Institute 
ients 
Normals pa 
Score (V=16) qa 
B 14 “ 
ct 43 k 3 4 
C ‘90 2 
: Tn 
D 42 4 


* Significant at .05 level. was 


** Significant at .01 level. art D 
t Tetrachoric z. The correlation of ‚62 for Part ifcance | 


4 f sign ich 
found to be significant at the .01 level if the test seric xis Which 
assumes normality. When tested by a nonparal ship is 


does not assume a normal distribution, the relation! 
nificant at about the -15 level, a \ 
The mean retest interval for the neti f 
group was 4.4 days, and for the Psy¢ 
Institute group it was 14.3 days. Je 

The ro ar of the three PE 
populations is summarized in Table 2. rmine 
square analysis was undertaken to dooi sig- 
whether any of the obtained scores we or 
nificantly differentiating. Only the f" igh- 
Part A score (performance employing 5 sta- 
level conceptualization) was found P ificantly 
tistically significant in that a signi jects 
higher percentage of the Normal toyed | 
than of the Brooklyn State group €™ Also, 
high-level conceptualization in Part A- Psy- 
a significantly higher percentage of the 


ey 


Zaslow’s Test: Reliability and Validity 


Table 2 


A Comparison of the Normal, Psychiatric Institute, 
and Brooklyn State Patient Groups on 
the Various Test Scores 


Psychi- 
atric Brook- 
Normals Institute lyn 


Item (N=23) (N=45) (N=23) 


Percentage of group 
employing high-level 
conceptualization 

Percentage of group 
placing triangle 
between cards 3 and 5 

Percentage of group 
Scoring 25 or higher 
in Part B 0 

Percentage of group 
placing circle at 
cards 11 and 12 

Percentage of group 
including “middle” area 
of four to eight cards 

Percentage of group 
maintaining boundaries 
in Part D 


61 67 17* 


30 
9 13 


26 42 48 


26 20 30 


35 29 17 


x Differs at the .01 level from Normals and from Psychiatric 
Institute grou p. 


chiatric Institute group than of the Brooklyn 
State patients employed a high-level concep- 
tualization in Part A. The difference between 
the Normal and Psychiatric Institute group 
is not Statistically significant on this seors 
No other intergroup comparison on ay a 
the five remaining scores yielded a statis! 
cally significant difference. 


Discussion 


The results of this experiment indicate a 
the Part B and Ct scores lacked Be ire 
both of the populations retested: ae 
three scores, Parts C°, C", and for one oF 
Statistically significant reliabilities 


for both 
roups, but not 2 
the other of the two one KA test. These find 


on any single portion NE 
ings would indicate that the teer os as 
is not sufficiently reliable for oF Sone 

A comparison of the three ey any por- 
exception, failed to yield scores 


igni ly dif- 
tion of the test that would significantly 
a 


RT, 
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ferentiate the normal from the experimental 
groups. It was found that on Part A, the dif- 
ference between the Normal and Brooklyn 
State sample was significant at the .01 level, 
but the same score did not differentiate the 
Psychiatric Institute group from the Nor- 
mals. Since only one of six scores was found 
to distinguish between the experimental and 
control groups, we would conclude that the 
differential power of the instrument for the 
populations under comparison is very ques- 
tionable. 

Thus the results of this experiment indi- 
cate rather low reliability, and very question- 
able validity for Zaslow’s test. As originally 
developed the test differentiated between a 
control and hospitalized chronic schizophrenic 
group. It appears to be inadequate for use in 
distinguishing between a normal control group 
and schizophrenics seen early in their hos- 


pitalization. 
Summary 


The Zaslow test of concept formation was 
administered to a group of normals, and two 
dissimilar groups of schizophrenics. The re- 
sults were analyzed in the same manner as 
that used by Zaslow in his study. The find- 
ings of this study indicate that the reliability 
coefficients obtained from the normal and 
the schizophrenic group were not statistically 
significant for both groups on any single por- 
tion of the test. Only one of six scores was 
found to distinguish between the experimen- 
tal and control groups. Thus, these results 
would indicate rather low reliability, and 
very questionable validity for Zaslow’s test 
for use in differentiating between normals 
and hospitalized schizophrenics seen early in 


their hospitalization. 
Received September 16, 1954. 
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The Effects of Serial Position and Design Difficulty 
on Recall of the Bender-Gestalt Test Designs 


Leonard D. Goodstein, Charles D. Spielberger,? John E. Williams,’ 


State University of Iowa 


and W. Grant Dahlstrom 


University of North Carolina 


There is little research literature on the sev- 
eral “nonpersonality” variables which may af- 
fect performance on visual-motor tests. It is 
the purpose of this Paper to offer evidence 
pertaining to the operation of the variables 
of item difficulty and order of presentation 
in producing differences in recalling designs 
from memory. It is possible that many of the 
differences in drawing performance among 
clinical groups that are currently ascribed to 
organic pathology or personality may be ac- 
counted for more economically within the 
framework of well-known serial learning 
principles. 

In the conventi 
Bender-Gestalt Te 
designs is presen 
order and copied 
of formal instruct’ 


} ons, with the im- 
portant exception that the S is not instructed 


to learn. 

Serial position effects ha 
extensively in verbal learni 
have been found to be an 


ve been studied 
ng situations and 
important source 

1The authors wish to acknowledge their indebted- 
ness to Dr. I. E. Farber of the State University of 
Iowa for his generous assistance in the planning and 
execution of this research as well as in the Prepara- 
tion of this manuscript. 

2 Now at Worcester State Hospital, 

3 Now at Yale University. 


of variance in the recall of learned material. 
The usual paradigm for such studies involves 
successive exposures of the material until 
some criterion of learning is reached. Reten- 
tion is then tested by some form of recall. It 
should be noted that the B-G procedure al- 
lows only one presentation of the materials 
with a free recall. No studies involving visual- 
motor performance approximating this gene 
digm have been found in the literature, an 
only one verbal learning study seems suff- 
ciently similar to this procedure to serve as a 
guide for hypotheses concerning serial he 
tion effects on this task. Welch and Burnet 
(5) reported a study in which a list of non- 
sense syllables was presented once with in- 
structions to learn. Testing by free recall was 
made immediately following the tachistoscopic 
presentations. The curves they reported for 
lists of eight syllables were interpreted as 
showing frequency of recall to be an increas- 
ing monotonic function of serial position 10 
the list. a 
The effect of the variable of serial position 
upon recall can be masked by the operation 
of many other variables, including design diff- 
culty. Although no experimental evidence 1S 
available as to the presence or extent of in- 
teritem differences in difficulty level on the 
B-G, the work of experimenters like Benton 
(2) strongly suggests that such differences in 
design difficulty on visual retention tasks may 
be appreciable. If this source of variance 1S 
important, it could obscure the relative con- 


tribution of serial position in determining Te- 
call frequency. 


It is highly probable that many variables 
other than those discussed above affect the 
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Effect of Serial Position and Design Difficulty on Bender-Gestalt 


recall of the Bender designs. Age, sex, previ- 
ous training, degree of maladjustment and 
other individual differences variables would 
seem to be of possible importance. The pres- 
ent paper is restricted to a relatively homo- 
geneous population in terms of these variables. 
The major purpose of the present investiga- 
tion was to study the effects of serial position 
and design difficulty upon the recall of the 

-G designs. The experimental design em- 
ployed, however, also afforded the opportunity 
of studying sex differences on this task. 


Experiment I 
Method 


Subjects. Fifty-four undergraduates, 27 
males and 27 females, from an advanced un- 
dergraduate course in psychology during the 

Pring, 1953, semester at the State Univer- 
Sity of Iowa served as Ss. 

Procedure. In order to study the effects of 
Serial position, nine arrangements of design 
Presentation were used; each arrangement 1n- 
Volved changing the serial position 0 A 
Signs while holding the sequence constant. 

ach arrangement was presented to three 
toy’ and three female Ss in an individual 
testing session. Each S was given a lead 
Pencil and a stack of 5% by 8%⁄2-inch white 
Paper and then shown the designs one by one- 

S$ part of the standard instructions, Æ a 
Plained that the designs would be presenti 
individually and that each design was to n 
Copied on a separate page within a 40-secon 
time limit, : 

Following a six-minute interpolated ae 
4-Derson task,’ each S was asked to draw 


m =e . he could re- 
ee the ae CEN ast sheet of 


Memb; ign on a Sep š 
Paper. The E net the recall ean <b 
Sight minutes unless S stated he ETT d. 
© more designs before this time ha SR 
Scoring, All recalled designs were pee table 
4 single author as acceptable or beet de- 
according to an arbitrary sooring Sawing’ 
Vised by the authors. In general, X : 
Nay ie ee aaa 
Met 
Curs in a different serial Oe oly with the recall 


This study is concer original drawings was 
2, of the Eg ed only to 


drawin is 

gs. No analys n task was use 

m The der of jaune ae interval be- 
1 11 0: . recall, 

Ween e ori nal drawing and 


f the de- 
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Table 1 
Summary of the Analysis of Variance—Experiment I 
Mean 
Source of variance df square iv 

Between Ss 53 
Sex (S) 1 052 
PXD 8 27 LN 
SXPXD 8 366 1.50 
Error (b) 36 244 

Within Ss 432 
Serial position (P) 8 333 1.76 
Design (D) 8 1.644 8.68** 
PXD 56 254 1.34* 
PXS 8 116 61 
DXS 8 .167 .88 
SXPXD 56 179 94 
Error (w) 288 189 

Total 485 

bu EE eee 
T Sas! 


were required to be suitable in the form of 
the elements, free of distortions in line or dot 
quality, contiguity of elements, rotation, or 
other variations in the pattern (4). No lim- 
its were imposed on size, tone, or page ori- 
entation of the figures.° 

As a reliability check, the drawings were 
rescored by another of the authors, with 86.3 
per cent agreement in scoring. Each S’s draw- 
ings were scored as a set, rather than scoring 
each design for all Ss at one time. It is be- 
lieved that this latter procedure would have 
improved the reliability, but the former pro- 
cedure is more in line with usual clinical 


practice. 


Results 

The data, which consisted of the propor- 
tions of correctly recalled designs, were ana- 
lyzed by a Lindquist Type IV mixed design 
(3, pp. 285-288) in which the separate B-G 
designs (D) and serial positions (P) com- 
prised the Latin square factors and sex (S) 
was a between-Ss factor. In this experimental 
design, the individual designs and the serial 
positions are completely counterbalanced. Es- 
sentially, the experiment involved two replica- 
tions of the counterbalanced factors, one with 
male Ss and the other with female Ss. 

The results of the analysis of variance of 
these data are reported in Table 1. As can be 


6 Mimeographed copies of these scoring standards 
may be obtained upon request. 
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Table 2 


Proportion of Ss Correctly Recalling Each Design 
and the SE of Each Proportion 


Designs 


Measure uo oes! 6 hg 


Proportion .85 .89 .80 .41 
SE prop 05 .04 .05 .07 


50 .67 .63 44 .65 
07 .06 .07 07 .07 


seen, no significant effect was found attribut- 
able to sex. Therefore, for subsequent analy- 
ses, the data for the two sexes were combined. 

The obtained F for design difficulty (D) 
was highly significant (~ < .001). Table 2 re- 
ports the proportion of Ss correctly reproduc- 
ing each design and the SE of each propor- 
tion. The differences among the proportions 
for the individual designs suggest that there 
are three levels of difficulty with designs A, 
1, and 2 about equally easy; designs 5, 6, 
and 8 about equal at an intermediate level of 
difficulty; and designs 3, 4, and 7 the most 
difficult according to the Scoring scheme used. 

The F test for serial position (P) in Table 
1 attained only a moderate level of Statistical 


3 o 


PROPORTION OF SS 
a 


8 


55) 


I 2 3 4 5 6 = 
SERIAL POSITION 


of Ss correc} 
Position in Experi 


SRS 


tly r i 
signs at each serial positi y recalling de- 
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significance (p < .08). The serial position ef- 
fects presented in Fig. 1, however, are so 
similar to the results obtained by Welch and 
Burnett (5) that further research seemed 
warranted. oak 

Although the obtained F for the within 
component of the “mixed” P X D interaction 
was barely significant (p < .05), the i 
pothesis of no interaction cannot be rejecte 
in this type of experimental design unless 
either or both components of this interaction 
are significant at the .025 level of confidence 
(3, p. 280). In the present experiment, there- 
fore, the hypothesis of no interaction must be 
retained. 

The obtained results suggested that the re- 
call of a design might be affected not only by 
the difficulty level of the design but also by 
its serial position in a given order of pres- 
entation; that is, design difficulty might in- 
teract with order of presentation. To test this 
hypothesis, as well as to cross validate the res 
sults as to sex and design difficulty, a secon 
experiment was performed. 


Experiment II 
Method 


Procedure. Two orders of presentation were 
developed on the basis of the rough estimates 
obtained from Experiment I of the telan 
difficulty of the nine designs (Table 2) ot 
of the nine serial Positions (Fig. 1). Order a 
(3, 7, 4, 6, 8, 5, 2, A, 1) involved placing i 
most difficult designs in the most difficult Ce í 
initial) serial positions and the easiest on 
signs in the easiest (the final) positions. he 
der II (1, A, 2, 5, 8, 6, 4, 7, 3) placed t s 
most difficult designs in the easiest porters 
and the easiest designs in the most Seni 
Positions. These orders permitted testing the 
interaction between difficulty of the design 
and order of Presentation. Each order va 
presented to 15 male and 15 female Ss. A 
other procedures were identical to those €M- 
ployed in the first experiment. 

Subjects. Sixty undergraduates, 30 males 
and 30 females, from the introductory PSY- 
chology course during the Fall, 1953, semester 
at the State University of Iowa served as 3S 
_ Scoring. All recalled designs were score 
independently by three of the authors, aC- 
cording to the same scoring scheme used i 

periment I. The scoring of an individua 
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a was the score given by the majority 
x e judges. The percentage of agreement 
r all three judges was 84.3; for the three 
possible pairs of scorers the percentages of 
agreement were 91.8, 89.7, and 87.1. 


Results 


Pe proportii of hard and easy designs 
Pa ctly recalled under the two orders of 
Of eee are shown in Fig. 2. The recall 
deste signs appears to be a function of both 
Aes difficulty and order of presentation, 
fs serial position. There was little dif- 
mene between the proportions of easy de- 
(1-3 feet 1, 2) correctly recalled at the hard 
hard Paty easy (7-9) serial positions. The 
rect] esigns (3, 4, 7), however, were cor- 
he y recalled by only 38 per cent of Ss when 
t ad pevees in the hard positions, while in 
per aed positions they were recalled by 58 
ie am of Ss. Order of presentation appears 
little er the recall of the hard items but has 
or no effect on the easy items. 
hese data were analyzed by a Lindquist 
ae II mixed design (3, pp. 281-284) in 
sex (S) and the order of presentation 
Tate x a between-Ss factors and the sepa- 
tor Th designs (D) with a within-Ss fac- 
a m € results of this analysis are reported 
able 3, 
ee be seen, the obtained F for the in- 
entation between design and order of pres- 
indicati: was highly significant ($ < 001), 
fun Ing that the recall of a given design is 
ction of both its difficulty level and its 


Sum Table 3 
Mary of the Analysis of Variance—Experiment Il 
sauce ws Mean 
tween Ss 
Oa 011 
sxo Q 1010 
E 153 
Within gO ‘201 


Ban 
COCO COS O m m ma 
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DESIGNS 


Fig. 2. The proportion of Ss correctly recalling the 
hard and easy designs in the two orders of presenta- 
tion. These curves are based upon the averages for 
the easiest serial positions (7-9) and the most diff- 
cult serial positions (1-3). While only data from the 
hard (3, 4, 7) and easy (A, 1, 2) designs are pre- 
sented here, the data from all designs were included 
in the statistical analysis. The data from men and 


women were pooled. 


a given order of presenta- 


serial position in 
eractions were statistically 


tion. No other int 


significant. 
The obtained F for design difficulty was 


the only significant ($ < 001) main effect, 
suggesting that difficulty level is the more im- 
portant variable affecting recall. No signifi- 
cant effect was found attributable to sex dif- 
ferences; therefore, in all the other analyses 
the data for the two sexes were combined. 
These results clearly confirm those of Experi- 


ment I. 
Discussion 


The procedure of this study deviated from 
the conventional clinical use of the B-G 
largely in the direction of greater precision 
and uniformity of stimulus presentation. 
Thus, the time spent on each design was 
held constant, the design exposures were fur- 
ther controlled by the use of individual sheets 
for copying each of the designs, and the in- 
structions were standardized. The interpola- 
tion of an interval filled with a drawing task 
was calculated to make the recall task more 
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difficult. This was done in order to get greater 
variability in the frequency of designs re- 
called in this group with high intellectual 
ability and to control the manner in which 
the interval was filled. Only the accuracy of 
the recalled designs was examined in the pres- 
ent study while clinical usage usually involves 
many more features of the drawings (4). 

It seems clear that these supposedly simple 
designs do differ in the frequency of recall 
even in this academically superior group. 
Little allowance is made for these design diffi- 
culty differences in the usual clinical inter- 
pretations of these drawings. Conclusions 
about a particular set of recall drawings 
should be tempered by adequate considera- 
tion of the variable of design difficulty, 

In the clinical use of the B-G a conven- 
tional order (A-1-2- , - . 8) is employed, 
In this order the easiest designs are in the 
most difficult serial Positions while the most 
difficult designs are in positions of intermedi- 
ate difficulty. It is not inconceivable that 
modifications in the conventional order might 
produce a more effective Psychodiagnostic in- 
strument. 

The absence of any significant interaction 
effects between design difficulty and sex casts 

n many of the clinical hunches which 
relate sexually relevant Personality character- 
istics to Particular design reproductions. The 
Scoring for acceptability, however, may not 
be sufficiently Sensitive to such distortions, 


Summary and Conclusions 
In an attem 


i ni » the effects of order of 
presentation, design difficulty, and sex on the 


free recall of the designs on the Bender 
Visual-Motor Gestalt Test (B-G) were in- 
vestigated. 


In Experiment I 54 college Ss, equally di- 


Presented with one of 
~ designs, followed 
a free recall ses- 


L. D. Goodstein, C. D. Spielberger, J. E. Williams, and W. G. Dahlstrom 


low level of statistical significance. The i 
sign difficulty X serial position interaction z 
fects were equivocal and difficult to inepe 
In Experiment II 60 college Ss, equally a 
vided as to sex, were presented with two o A 
ders of the B-G designs. In one order t i 
most difficult designs were placed in the wee 
difficult serial positions while in the es 
der the most difficult designs were place fe 
the easiest serial positions; difficulty of aa 
signs and of serial position was ee. 
from Experiment I. The remainder of E 
procedure was identical to that of Experim ‘ 
I. The designs were scored for ace RA 
the frequency of correct recall was treate ie 
an analysis of variance for design = ot 
order of presentation, and sex. The effec TA 
design difficulty and the interaction DEEN a 
order of presentation and difficulty were 
only statistically significant effects. a 
The present investigation would seem 
Support the following conclusions: A 
1. The B-G designs differ signiñcantiy 3 
ease of recall, even in an intellectually 
erior population. 
: 2 BG designs A, 1, and 2 appear to be be 
easiest; designs 3, 4, and 7 appear to Fi ae 
most difficult; the remaining designs f 
an intermediate level of difficulty. tion 
3. The recall of a given design is a Tt of 
of both its difficulty level and its seria p 
sition in a given order of presentation. ales 
4. At the college level, males and ten te 
do not differ in total frequency of correc tion 
call, nor in frequency of correct reproduc 
of any particular design. 
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Books 


Al 
is Robert M. Elements of Rorschach interpreta- 
Ha New York: International Universities Press, 
954. Pp. v +242. $4.00. 


eha though this textbook on the use of the Ror- 
can s 41S presented at a rather elementary level, it 
schach 7 be claimed that the elements of Ror- 
ment papetPretation receive a comprehensive treat- 
Perfor: ‘aking as his theme the statement that “every 
ian ine of a person is an expression of his whole 
ceeds ‘ality, perception included,” the author pro- 
mode to offer personality interpretations for various 
eral es Tesponse to the Rorschach cards. In gen- 
cane ìs discussions are rich in claims for the signifi- 
and Son Rorschach responses, but poor in rational 
Cong; mpirical justification for these claims. To a 
Doing uous degree, the textbook is a recital of m 
the of view, opinions, insights, and practices 0: 
Br author, It does not appear to be an impersonal 
or pation of commonly accepted elemental bases 
Rorschach interpretations. —J. R. W. 
Deutsch, Felix, & Murphy, William F. The clinical 
interview, Vol. 1. Diagnosis. New York: Inter- 


national Universities Press, 1955. Pp- 613- goa 
t This is the first of two volumes on the clinical in- 
“tview, and is devoted to diagnosis; the second 
Volume, Promised shortly, is to deal with the clini- 
cal interview and psychotherapy. Both are designed 
Or the training of psychiatric residents. Judee 
;{0™ the published volume, they can also serve We 
în the training of clinical psychologists. The authors 
develop two interesting concepts: the “associative 
Anamnesis,” which is a method of “guided free 2°50" 
“ation” for diagnostic purposes, and Pee Er: 
“apy,” which is a goal-limited type 0., differ- 


Y mea rded interviews 
ns of 21 reco nt syndromes, Deutsch 


Patients showing differe: $ i 

anq Murphy oomen HE technique in T 
Interview is preceded by 2 discussion ot S as: 
‘DVolved and a brief summary Sea with com- 

interviews are generously nate nian is de- 
ments and interpretations. EnD is expected to 
Signed as a complete entity, aBer on “The 
achieve a predetermined goal. 


prepared by the Editor 


Note.—The reviews oe may be identified by 


tnd the Advisory Editor 
eir initials. 


Application of Psychoanalytic Concepts to Resident 
Training and the Technique of the Therapeutic In- 
terview” is particularly worthwhile—M. K. 


Donahue, Wilma T. (Ed.) Education for later ma- 
turity: a handbook, New York: Whiteside, Inc. 
& William Morrow, 1955. Pp. xiii + 338. $4.50. 

Our machine age has produced increasing hours of 
leisure. At the same time there has been a rapid ex- 
pansion of the life span, so that the proportion of 
older people in our society has increased, Adult edu- 
cation finds a real challenge in meeting the needs 
and demands of these mature years. Education for 
Later Maturity presents the problems of the aging 
period, together with the present attempts to meet 
them. It stresses the guiding principles that must be 
established in order to make satisfactory solutions. 
Adult education is envisaged not as a meeting of 
emergency needs, but as a lifelong process. If so 
conceived, the well adjusted years of maturity are 
not a period requiring specific education, but are the 
culmination of a process of lifelong adjustment to 
growth and change. Each chapter presents a sepa- 
rate aspect of the problem by different authors. The 
book is so carefully conceived and edited that there 
js no overlapping. The reader has a feeling of unity 
and cohesiveness unusual in a book of this nature. 
There is excellent coverage of all phases of adult 
education, and a careful review of the present pro- 
gram, often with a frank evaluation of possibilities 
and limitations. The book will prove profitable read- 
ing for anyone who is working with mature people 
or who is facing the problems of later maturity him- 


self —B. M. L. 


Edwards, Allen L. Statistical methods for the be- 
havioral sciences. New York: Rinehart, 1954. 
Pp. vii +542. $6.50. 


This is an elementary book in statistics. With re- 
spect to style, format, and content it falls clearly in 
the pattern of textbooks that have been accepted by 
departments of psychology for undergraduate courses 
in statistics. The area covered, however, exceeds the 
work that can be expected from a one-semester 
course at the undergraduate level. For the most part 
the treatment is modern and it should be noted that 
a chapter on significance tests for ranked data is in- 
cluded. It is likely that the reader will find this text 
to be an improvement over Edwards’ earlier text on 
statistical analysis—J. R. W. 
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Macfarlane, Jean W., Allen, Lucille, & Honzik, Mar- 
jorie P. A developmental study of the behavior 
problems of normal children between twenty-one 
months and fourteen years. Berkeley and Los 
Angeles, Calif.: Univer. of California Press, 
1954. Pp. vii +222 (paper). $2.25. 

This report is offered as a contribution to our 
knowledge of the problems and developmental cir- 
cumstances of children who are not the subject of 
special therapy or guidance. The writers suggest that 
the data are more descriptive of a “normal” popula- 
tion of families than are data based on families who 
come to clinics because of referrals. Although the 
work presumes to offer no more than a description 
and suffers the obvious limitations of an account of 
children who lived in one particular area (and of 
necessity at one particular time), it is a storehouse 
of information and may be a source of hypotheses 
for subsequent investigations and a catalog of bench 
marks useful for comparison and reference. The sam- 
ple comprised 126 infants who were examined at 
regular subsequent intervals, with diminution of 
numbers resulting from the usual factors which in- 
terfere with “follow-up” studies, One of the most 
interesting features of this publication is the pres- 
entation of the relative incidence of various types 
of “problem” behavior through the critical period 


beginning at age five and ending at age fourteen.— 
J. R. W. 


Meerloo, J. A-M. The two faces of man. New York: 


International Universities Press, 1954. Pp. x+ 
237. $4.00. 


This little volume contains two essentially inde- 
pendent long essays. One, entitled “Father Time,” is 
a thoughtful consideration of the psychology of time 
perception and the experience of duration and tem- 
poral relationships. The other, 


v the Two Faces of 
1s reputation for in- 
novation and gentleness.—E. J, 5. brs 
Remmers, H. H. Introduction to o 
tude measurement. New Yor 
Pp. viii +437. $5.00. 
Although written as a text for a 
course in attitude measurement, 


Pinion and atti- 
k: Harper, 1954. 


m undergraduate 
this well-written 


New Books and Tests 


volume provides a useful survey of the methods and 
problems of attitude measurement for anyone whoa 
training did not include such a course at either H à 
undergraduate or graduate level. Part I, entitled 
“Techniques of Attitude and Opinion Measurement, 
includes a discussion of all current techniques except 
those recently introduced by Coombs. Part II, the 
last half of the book, includes chapters on the ap- 
plication of opinion and attitude measurement in 
business, government, industry, community relations 
and education. Each chapter is concluded with 5 
series of thought-provoking questions (many 0 
which are not answered in the text!) and a se- 
lected bibliography —E. L. K. 


i hosur- 
Robinson, Mary F., & Freeman, Walter. Psyc 

gery ‘and the self. New York: Grune & Stratton, 

1954. Pp. ix + 118. $3.00. 


There is packed into this clear and carefully vee 
ten 118-page book an explanation of psychos 
including the less drastic transorbital lobotomy, tive 
scriptions of postlobotomy personalities, an objec 
and concise review of the literature on the proce “iE 
as well as current psychological concepts of the ai 
This gives perspective to an experiment on the R E 
of the standard psychosurgery on the patient’s Si 
as compared with a control group of patients be 
recovered without the operation. Dr. Robins 
basic hypothesis is that psychosurgery changes city 
structure of the self through reducing the abe ro- 
for the feeling of self-continuity. Her design 
vides evidence substantiating the hypothesis, na un- 
experimental adventure into this important ed 
explored area of psychology should stimulate th ple 
and research. Her methods seem intriguingly a 
but penetrating, and her insights into the funca aaa 
tal changes after prefrontal operations are satis baci 
The undesirable changes which are found along ae 
reduced anxiety, introversion, and nenon ean arly 
indicated throughout the book, and it is ee 
stated that the study is investigative rather de- 
evaluative. Nevertheless, the reviewer feels thane 
spite Dr. Robinson’s scientific objectivity and able 
esty, the flavor of the volume is definitely favor 
to psychosurgery—F. McK. 


A Jew 
Sappenfield, Bert R. Personality dynamics. N 


3 2m 
York: Alfred A. Knopf, 1954. Pp. xiv +41 
xvi. $5.50. 


gra- 

In this text, the subtitle of which is “An Deeg 
tive Psychology of Adjustment,” the author Paka 
tempted, first, a systematic presentation of Py o: 
analytic principles and, second, an integratio con- 
Psychodynamic principles with an organismic loy- 
ception of behavior. Furthermore, although eober 
ing much of Freud’s original terminology, the SMOE 
attempts to redefine such terms in language con- 
common to American psychology (the glossary ts al 
tains almost 300 such definitions). In these effor ag 
integration, the author proposes what he regards e 
four contributions to conceptual clarification: (a) ic 
definition of id functions as those involving biogen! 
need-tensions, ego functions as those involving €08 
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nitive (intellectual) and voluntary processes, and su- 
Perego functions as involving all aspects of psycho- 
genic motivation; (b) the analysis of motives into 
three components: need, instrumental act, and ob- 
ject; (c) equating the concepts “id functions” and 
anxiety and defining both as “the occurrence in con- 
Sclousness of biogenic need-tensions without con- 
scious representation of instrumental acts or objects 
a relation to which gratification or relief may be 
anticipated”; (d) the distinction between perceptual 
identification and developmental identification. Em- 
phasis throughout the text is on the development 
a functioning of the normal personality, and al- 
ough Pathological conditions are often used by 
Way of illustration, it is not a textbook in abnormal 
py chology. For example, the word “schizophrenia” 
st 4 not appear in a twelve-page subject index. In- 
ead, it is a text which seeks within a single volume 
(a) to familiarize the student with all essential as- 
ects of psychoanalytic theory, and (b) to get him 
eats habit of using this theoretical formulation and 
th nology in thinking about his own behavior and 
Atot his peers. As such it is not an easy text. I 
Predict that undergraduates will find it interesting 
T dificult. Graduate students should find it a help- 
erena eduction, especially in view of the many ref- 
Plet, T, to original sources. The style is almost com- 
RA didactic with practically no reference to the 
esse. Odological problems of assessing dynamic Prot 
eta, to the variables involved, or to empirica 
les bearing on the topics discussed —E. L. K. 
Savage, Leonard J. The foundations of statistics. 
New York: Wiley, 1954. Pp. xv + 294. $6.00. 
k Lest the prospective reader be misled by the title, 
should be stated at once that this is not an intro- 
Uctory text in statistics. In fact, it is not â ee 
aes at all but rather a highly sophisticated A 
ere of the philosophical and logical sean 
Atistics “as a discipline of rational decision 1n s 
k of uncertainty.” The author develops and er 
aen the currently somewhat unfashionable inate 
fen viewpoint” of probability and then discus 5 
S implications for observation and experimenta 
cision making, and for curr t statistical the 
Bate rene The EEF sE 
i reader should have s na 
Yea, © theory A mathematical probability, at least a 
“ar of calculus and some training 1 fori ANAS 
addition, it is suggested that he should “si! 


Upri $ ? though the 
Pright on a hard chair at a desk.’ Ey TNE worked 


tend ti 


vesent reviewer does not pre he 
i in this manner, | 
S Way through all of the Bodh apies highly in- 


did find the Iess mathema 
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formative and thought provoking. He believes that 
many other psychologists will find it worth a few 
hours of their time. A bibliography of some 170 
items is included—ZE. L. K. 


Tests 


Drake, Raleigh M. Drake Musical Aptitude Tests. 
Ages 8-adult. 2 forms. (80) min. Microgroove 
phonograph record ($5.95); self-scoring answer 
pads, musical memory ($2.45 per 20), rhythm 
($2.45 per 20); manual, pp. 32 (75¢); specimen 
set ($6.95). Chicago: Science Research Asso- 
ciates, 1954. 

The Drake tests are the outcome of a life career 
devoted to measurement in music, and are a sub- 
stantial contribution to their field. In place of the 
more familiar potpourri of short samples, these tests 
measure only two kinds of performance, at a length 
that permits adequate reliability (mainly .85 to .95). 
The two subtests have very low correlations with 
each other and with age and intelligence, and moder- 
ate correlations (about .35) with musical training. 
The norms are remarkably stable among several na- 
tional and ethnic groups. Validity, unfortunately, is 
reported only in terms of correlations with teachers’ 
ratings, but such correlations are about as high as 
the reliabilities of the ratings would permit. The 
manual conforms to high standards in displaying ex- 
tensive and relevant data. Both musically and psy- 
chometrically, this is a good test.—L. F. S. 


Thorpe, Louis P., Meyers, Charles E., & Sea, Mar- 
cella R. What I like to do, an inventory of chil- 
dren’s interests. Grades 4-6. 1 form. Untimed, 
(50-60) min. Hand or IBM scoring. Booklet 
($2.95 per 20); IBM answer sheet ($2.90 per 
100); profile sheet (90¢ per 20); manual, pp. 
16 (25¢); specimen set (50¢). Chicago: Science 
Research Associates, 1954. 

What I Like To Do is an uninspired but work- 
manlike job in the construction of an interest in- 
ventory for grades 4 to 6 and, by implication but 
without data, for grade 7. The 294 items assess in- 
terests in art, music, social studies, active play, quiet 
play, manual arts, home arts, and science. The items 
were developed from the literature on children’s in- 
terests, and were screened both by judgments and 
by an empirical trial. National norms are based on 
3,803 children in grades 4 to 6, and Kuder-Richard- 
son reliabilities of the separate parts center around 
87. A general factor of liking things seems to be 
present, as most of the scale intercorrelations exceed 


.50—L. F.S. 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 


1. Sends the Brief Report, limite: 
Page and prepared according to 
given below, 

2. Also sends to the Editor 
search study, in sufficient detail to givi 


d to one printed 
the specifications 


4. Agrees not to submit t] 


: i he full report to another 
Journal of general circulation, 


Specifications 
a clear, condensed 


of the study and a 
sults as space permits, 


To insure that the Brief Report will bea 
longer than one printed page, its a, : 
including all matter except the title an E 
author’s lines, must not exceed 70 lines m 
eraging 42 characters and spaces in leng of 
Set the typewriter margins for short lines 
42 characters, which are 3.5 inches ong 1 
elite typing, and 4.2 inches long in pica. 

This madisen of the Brief Report on 
be double spaced throughout. Except for 1) 
short lines, it follows the standard style Ga 
Headings, tables, and references are avol 70 
or, if essential, must be counted in the ai 
lines. Each Brief Report must be on 
panied by a footnote in the style be sA 
which is typed on a separate sheet and ? 
counted in the 70-line quota: * 


*An extended report of this study may be o 
tained without charge from John Doe, 300 R 
St., Prospect 6, Mass. (giving the author’s ful Docu- 
and address), or for a fee from the American pe 
mentation Institute. Order Document No. —— lica- 
ADI Auxiliary Publications Project, Photodup oa 
tion Service, Library of Congress, Washingt or 
D. C., remitting in advance $—— for micron 
$—— for Photocopies. Make checks payable to 
Photoduplication Service, Library of Congress. 


Extended report. The full report is p 
pared in the style specified by the Puba 
tion Manual (1), except that it may be E 
with single spacing for economy in pho 
duplication by the ADI. 
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T : i 
, +Wo tendencies seem constantly at work in’ 


ivi : 
one systems: the tendency to integrate a 
Parts le and stable arrangement of internal 
ad and external relationships, and the in- 
Bona opposite of this, the tendency to re- 
tom i variably either to pressures arising 
condi internal structure or to new external 
old a in such a way as to break down 
With orms of organization and replace them 
I new ones. 
FA > psychoneurosis, which is in part at least 
exte ttempt to stabilize matters internally and 
ari: Joally; one might expect also that forces 
woule internally and tending towards change 
he be at work, As Eysenck (3) has pointed 
of i in his review of reports on the incidence 
gime ovement under varying therapeutic T°- 
whine” the rate of spontaneous remission 1n 
ohne psychoneuroses is almost identical 
Sive the recovery rate reported when inten- 
y. Psychotherapy has been applied. While 
geet analysis of these reported data has 
a n challenged by Rosenzweig (9), and per- 
in Ps cannot be considered to be compelling 
un the light of Rosenzweig’s criticisms, it 15 
a doubtedly true that a substantial percent- 
ce of untreated psychoneuroses and psy- 
Oses make some sort of recovery- 
> 5 
eg present investigation is one of a seri 
ha sponsored by the Kaiser 
tan California, and supported in t a 
tay MH-331 from the National Institute of Men- 
cia) eat Public Health Service. Part of the eon 
of ,uPPort for the present study came from à gra 
tio the Medical Division of the Rockefeller Foun a- 
ae to the Institute of Personality ‘Assessmen 
Search, Berkeley, California. 


es of 
Oak- 


t and 


and, California 


To say that a remission is spontaneous, 
is generally to make a confession of 
ignorance; what we mean is that a change 
has occurred for reasons which we do not un- 
derstand. When a change in the psychic state 
of a patient has occurred concurrently with 
the application of psychotherapy, we usually 
feel that we do understand the causes of the 
change. Unless, however, we are certain that 
there is a significant increment in the recov- 
ery rate when psychotherapy is applied, we 
may be deceived in attributing the changes 
we have observed to the psychotherapeutic 
forces we think we have applied. Hence the 
importance of research into psychological 
change under systematically varied conditions. 


however, 


The Present Research 


This paper reports the results of a study in 
which 150 psychoneurotic patients all drawn 
from the same clinic population were tested 
with the Minnesota Multiphasic Personality 
Inventory before and after an interval of 
time during which some of them received 
psychotherapy and some of them did not. All 
150 patients had applied for psychotherapy 
in the psychiatric clinic in which the study 
was conducted, and all of them had been ac- 
cepted for treatment; a group of 23 cases, 
however, had to be placed on a waiting list 
until therapeutic facilities became available, 
and they waited some six months before be- 
ginning treatment. Of those who received psy- 
chotherapy immediately, 85 received group 
therapy, and 42 received individual therapy; 
they included only those patients treated for 
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a minimum of three months during the pe- 
tiod of time covered by the study. 

The aim of the study is to discover what 
changes, if any, occur in MMPI profiles of 
patients who receive psychotherapy, and to 
compare these changes with whatever changes 
may be observed in the MMPI profiles of pa- 
tients who during the same period of time re- 
main untreated. 

Other investigators, such as Kaufmann (5), 
Gallagher (4), Mosak (7), and Rashkis and 
Shaskin (8), have reported observations of 
MMPI changes following psychotherapy; the 
distinctive feature of the present research is 
the use of a control group consisting of pa- 
tients who are in need of therapy and who 
want it, but who do not receive it. 


The Psychotherapists who worked with the 
treatment grou 


cial workers, 
had at least 
Postgraduate 
theoretical ori 
Was psychoan 
lytic method 


what in its grea! 
terpersonal responses; 


pecial arrange- 
assignment of pa- 
ntreatment groups, 
or psychotherapists 


considered themselyes involved in a research 


program. 
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This is perhaps not the ideal design for a 
study in which an untreated control group is 
to be used to establish a base line for evaluat- 
ing the unique contribution of psychotherapy 
to the amelioration of the psychoneurosis. In 
a less real world, for example, the research 
psychologist in a clinic might assign new pa- 
tients randomly to treatment and nontreat- 
ment groups, and he might also set some 
standard interval as the period of time we 
should elapse between the determination k 
the patient’s state at the beginning and a 
the end of the experiment. The experimen- 
tal (treatment) and control (nontreatment) 
groups would then be comparable in terms A 
principle of selection, and might be epeo 
not to differ significantly from one anoa 
in severity of initial condition, diagnosis, 2 
prognosis. Furthermore, an equal length, 4 
time would have elapsed between ¢ — 1 oo 
tial state) and #—2 (terminal state) f0 
both groups. i 

Under the pressing practical demands e 
clinical work, it is difficult to arrange a i 
search design which will satisfy perfechy 
these ideal conditions. The decision not 3 
treat is always a critical one in any mas 
peutic practice, and in psychiatric work espe 
cially such risks as suicide, psychosis, ye 
various other personal and interpersonal “al 
tastrophes are possibly attendant upon an va 
fortunate decision, Random selection of P 7 
tients for treatment and nontreatment grosii 
is therefore not possible in a situation vara 
the medical responsibility is properly t 
paramount one. ashe 

It is also not possible to establish in aa 
vance the exact duration of treatment. Trea 
ment may be terminated at the decision i 
the patient at any time. Furthermore, em 
termination of treatment is sometimes Daa 
cated for technical reasons, and is brovi 5 
about by the therapist. Again, in some CaS E 
the tempo of work is much slower, and ter 
ment necessarily takes longer. Finally, oe 
dents of circumstance, such as a change y 
residence or in place of employment, ie 
operate to cause interruption of treatment 


‘rable 
fore the lapse of time specified as desirab 
for the experiment. 


In spite of these irregularities, the esika 
of the present study remains fairly clear-cut 


Changes in Patients With and Without Therapy 


As it happened, the experimental and control 
groups turned out to be quite comparable 
with one another in diagnosis, prognosis, 
Severity of initial condition, age, sex, and 
education. These comparisons will be pre- 
Sented below. Furthermore, the interval be- 
tween ¢— 1 and ¢ — 2 was an average of 7.00 
Months for the nontreatment group, 8.32 
Months for the individual psychotherapy 
8toup, and 8.63 months for the group therapy 
Stoup. These means do not differ signifi- 
cantly from one another (F of 2.5, p > 05). 


Characteristics of the Sample 


ill po ne of the patients in this study was so 
to r tbe time of application for treatment as 
Nos are hospitalization. They were diag- 
Toses most commonly as psychosomatic neu- 

S, obsessive or schizoid characters, OF 
peers (anxiety neuroses, etc.); less com- 
teri Y, as psychopathic characters or as iye 
yeas. The average age of the’ group was 3 
oi the average education was one year of 

€ge. Of the 150 patients, 97 were women; 


's preponderance of women is characteristic 


of the clinic. 
eae difference in proportions of men ee) 
Was en in treatment and nontreatment Boule 
stitute Ot statistically significant: gome pa 
and sa 67 per cent of the nontreatment 8! i ip 
Cen 3 per cent of the treatment group, apa 
tage difference which gives a CR 0! “~ 
of ‘05. No sex differences were found in any 
the further comparisons presented in 
Bets though computations were done sepa- 
^tely for men and women; combined totals 
tiq Pot sexes are therefore given when sta- 
Ìcs are cited. a 
A t was indicated above that treatment ne 
°ntreatment groups did not differ i5 f 
ently in age, education, of diagnosis. ON 
mally, they compared as follows: a age, 
arene send er A respectively: 
schooling, the mean of the treatment group 


W tment group was 
aS 13.6, that of the nonltet ie 2.7 and 2.3. 


2.8; ive sigmas i 
‘8; the respective 518 ; 
n a oi Che group Pee es ci ae 
Ypes of neuroses recognized in the simp ane 

MPT-based diagnostic scheme (6) used in 
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the Kaiser Foundation Psychological Research 
Project were as follows (treatment group per- 
centage given first, nontreatment group next) : 
Psychosomatic 19 per cent, 18 per cent; Hys- 
teric 6 per cent, 9 per cent; Psychopathic 7 
per cent, 5 per cent; Obsessive 19 per cent, 
23 per cent; Schizoid 21 per cent, 23 per 
cent; Phobic 12 per cent, 18 per cent; Un- 
classified 16 per cent, 5 per cent. None of the 
percentage differences in any category is sta- 
tistically significant; the largest CR, that for 
the difference in the unclassified category, 
was 1.54, the others being less than 1.00. 

The patients in the treatment group who 
were assigned to individual psychotherapy 
were also compared as a class with those 
patients assigned to group psychotherapy. 
These two treatment subgroups did not differ 
significantly from one another in any of the 
comparisons presented above. Hereafter the 
descriptive statistics for the two subgroups 
will be presented in detail, since it is of some 
erest to compare the amount and kind of 
change following group psychotherapy with 
the amount and kind of change following in- 
dividual psychotherapy. i 

The logic of the experiment requires that 
treatment and nontreatment groups be com- 
parable in terms of prognosis and of severity 
of initial condition, as well as of diagnosis. 
The MMPI provides a basis of comparison 
on both points. The test was scored not only 
on the commonly used clinical and validity 
scales, where scores would indicate severity 
of the psychoneurosis, but also on a new 
scale developed by one of the authors (1). 
This scale, called the Ego-strength (Es) scale, 
was designed originally to predict response of 
psychoneurotic patients to psychotherapy, and 
it proved to have substantial validity for that 

urpose in three samples beyond the stand- 
ardization sample. Its other correlates in both 
normal (2) and clinic samples led to its be- 
ing interpreted as a measure of ego strength, 
and it was accordingly so named; however, 
its most important clinical function is as a 
prognostic indicator. 

On all of these MMPI scales, then, there 
should be no difference between the treatment 
and the nontreatment groups at ¢— 1. The 
appropriate comparisons are presented in 
Table 1. 


int 
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Table 1 
Comparison of Treatment and Nontreatment Groups on MMPI Scales at {—1 
Individual eh aa P ee 
sychotherapy psychotherapy 
a (N=42) (N=85) (N=23) 
MMP: F 
ae Mean SD Mean SD Mean SD t 
ar EJE 40 71 5.19 1.03 
1. Li 48.04 6.76 47.70 5.25 49.70 5. 98 
LE 61.00 12.01 60.14 12.16 58.74 794 T 
3. K 51.16 7.29 51.34 8.31 54.96 4.89 0.08 
4. Hs 6140 13.61 61.18 13.19 60.04 15.43 208 
5.-D 78.71 12.25 73.60 13.72 76.13 12.92 0.08 
6. Hy 67.21 8.87 66.40 10.38 66.87 13.78 009 
7. Pd 67.57 14.65 66.75 12.08 67.83 12.73 0.82 
8. Pa 63.66 10.22 61.17 10.76 62.13 8.37 1.29 
9. Pi 73.09 13.75 69.52 12.70 72.65 12.00 088 
10, Sc 71.50 17.56 68.00 13.69 67.83 12.81 284 
11. Ma 55.88 10.51 54.80 10.32 49.96 10.05 0.24 
12. E” 41.05 3.46 41.76 7.35 40.80 6.16 j 
iv Es. ini lations is 41, and the SD 7.5. None 
E Ta SG a Ee TI pran ler lnie dominios bande SP TS ranee, 1 
of the F tests shown here indicate statistically significant differences, 


As Table 1 shows, the groups did not differ 
significantly from one another either in ini- 
tial severity of condition as indicated by the 
MMPI clinical scales, or in prognosis, as in- 
dicated by the Es scale. Since they were simi- 
lar also in diagnosis, and in age and educa- 
tion, it may be concluded, as far as the main 
variables relevant to this study are con- 


cerned, that all three subsamples were drawn 
from the same population. 


Since this is So, the essential conditions on 


which the &roups are varied are these: (a) 
whether or not the patients received psycho- 
therapy in the interval between t—1 and 


G S: 2; and (b) whether the patients who re- 
ceived psychotherapy were given individual 


lationships between 
of change, as shown in 


tween MMPI profiles at ¢ 


= Land ¢— 2, will 
be described next. 


Change with Psychotherapy 


For each MMPI scale, 
tween the scale score at 
was computed for each p 
at all had been brough 
therapy, one would expect the mean discrep- 
ancy scores on all MMPI scales for the treat- 
ment groups to vary in a chance manner 


the discrepancy be- 
+—1 and at ¢~2 
atient. If no change 
t about by psycho- 


about zero. That such is not the case may 
be seen from Table 2. 

As Table 2 shows, a significant decren 
occurs in the Depression, Hysteria, B 
chondriasis, and Lie scores following Psy ith 
therapy, whether individual or gener: 
group psychotherapy, there is a Seeli 
decrease in the Paranoia and Psychast y 
scores as well. With both forms of pee ; 
there is a significant rise in the cae 
Scores. Finally, for the individual psycho ain 
apy patients there is also a significant ris 
the K scale. e 

These findings accord closely with E. 
reported by other investigators. canas w 
(4) found, in a study of 42 university iing 
dents treated by the nondirective couns¢ = 
method, that D, Hs, Pt, and F scores hi 
creased significantly following therapy; wk 
K increased significantly. Rashkis and Sha : 
(8) found significant decreases in D, Hs, (7) 
and Pt following group therapy. Mosak 4 SC 
found decreases in D, Hs, Hy, Pa, a ee 
following individual client-centered oa 
ing in 28 cases. Kaufmann (5) ea 
university students who had been rate BA 
“improved” following psychiatric treatm Pl, 
and found significant decreases in D, ha 
Sc, Pa, and F, and a significant rise in K- 


Changes in Patients With and Without Therapy 


At this point a word about the measure of 
change seems in order. Since the MMPI calls 
upon the patient to testify concerning him- 
self, and particularly concerning his psychi- 
atric condition, it is subject to all the kinds 
of distortion to which seli-representation is so 
Peculiarity liable. Taken in a clinic, where it 
e a maby to be scrutinized closely by 

a who can be, or already are, very sig- 
maent in one’s life, it is likely to become a 
ve munication beyond and apart from the 
“ rt meaning of the words. It may be a plea, 
ice or a rebuff, or an act of ad- 
catio lon; in brief, an interpersonal communi- 
ition es expresses something of the re- 
the Ship of the individual patient to his 

rapist and to the clinic. 

ah his being inevitably so, it would seem to 
or Cove the psychological researcher to look 
: dence of change in other kinds of func- 
the he performances for consideration with 

IMPI. In the absence of such other evi- 
ence, all that one can do is keep in mind that 
oh is a possibly distorting element of self- 

a esentation present in questionnaires. (Per- 
0 = » however, rather too much has been made 

; he fakeability of tests; life itself can be 
aked, and many a “cure” is maintained for 
pie in the interests of an unresolved trans- 
ay ence. Furthermore, it may reasonably be 

Sued that durable character traits have & 
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way of showing themselves without one’s con- 
scious or even unconscious consent, and that 
the validity of so well-studied an instrument 
as the MMPI is not likely to be massively in- 
fluenced by momentary set.) 


Percentage of Improvement 


In addition to measuring change simply by 
considering the average discrepancy score for 
each scale, it is of some interest to inquire 
into the percentage of change for the better 
on the scales which do show change. On the 
scales which most directly reflect neurotic 
symptoms of which the patient complains 
(Hs, D, and Hy), the percentage of change 
in the direction of fewer complaints ranges 
in the present study from 61 per cent to 67 
per cent. This observation concords well with 
the estimate which Eysenck reports as an 
over-all rate of improvement with therapy 
from the data he collated. His judgment was 
that an estimate of improvement or recovery 
wo-thirds of the cases would prove “not 
» The Ego-strength scale, as a 
howed an increase on second 
t of the cases. None of 
the other scales changed in the “improved” 
direction in-as many as 60 per cent of the 
profiles in the sample; the Lie scale, how- 
ever, did decrease on second testing more than 
twice as often as it increased (52 per cent vs. 


in t 
very far out.’ 
matter of fact, s 
testing in 66 per cen 


Table 2 


Discrepancy Scores (kn — kt) on MM. 


PI Scales for Treatmen' 


t Groups and Nontreatment Group 


Nontreatment group 


u psychotherapy 
Individual psychotherapy Graae, (N =85) (N=23) 
MMPI (v=) M 
Scale = ; Mean SD t Mean SD t 
ap ee S 158 520  278* 3.09 484  299* 
z bie 17 446 2.57 032 807 036 -113 4.79 Ll 
3 3 0.74 14.67 De, —0.86 6.55 1.20 1.30 5.63 1.08 
R -271 7.48 2.32" 250 9.59 2,30" 3.00 8.01 1.76 
5 Us 373 11.290 238 11.60  204* 274 966 133 
RD 326 15.63 rA 251 823 2.79* 348 9.37 1.74 
7 By 443 10.64 2.08 iio 919 139 457 9.47 2.26" 
i Pa 0.57 1245 yoy 209 69  274* 191 825 108 
9, a 169 10.58 we 2.58 11.54 2.05* 1.04 8.56 0.57 
A, be 400 14.44 ; 101 10.80 0.86 =213 8.61 1.16 
0. S, 0.53 
u 138 1652 pia 022 871 0.23 —1.61 868 0.87 
12 E4 —0.52 na 238* —1.40 7.14 2.10* —1.80 3.85 2.04* 
—2.62 . : 
s nt from zero at .05 level of confidence. 


$ Mean di igni iffere 
ean d nc! significantly dit scores. 
+ Cont discrepapased on raw scores rather than 
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25 per cent), but also remained the same 
much more often than did the other scales. 


in a better mood (less depressed), are not as 
hypochondriacal, and are both less defensive 
(as shown in the Lie Scores) and less given 
to repression as a defense mechanism (the 
Hysteria scale). The increase in the K score 
in the individual Psychotherapy patients no 
especially 
since it was found to increase following ther- 
apy in some of the other studies cited. The 
common interpretation of K is that it indi- 
cates defensiveness, and that a high K score 


ich involves 


light than 
actual clinical condition would warrant. How- 


Changes in the Control Group 


Patients who received Psychotherapy clear] 
y clear 
responded differently to the MMPI aed hey 


From Table 2 it is evi 
tients who were waiting 
somewhat fewer complain: 
ing, although most of th 


dent that the pa- 
for treatment had 
ts on second test- 
e clinical scales do 
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not change significantly. Où the neurotic triad 
(D, Hs, Hy) the average decrease is slightly 
greater for the controls than for the no 
psychotherapy patients. The percentage Si 
change for the better in those scales average’ 
61 per cent in the control group, which ia 
slightly, but not significantly, less than in t F 
psychotherapy groups. There is a significan 
increase in the control group in scores on E 
which would suggest that at the end of t F 
waiting period the patients are somer 
more amenable to psychotherapy than at i 
beginning of that period. The actual perce 
age of patients who improved on Es in it 
control group was 55 per cent, compared aaa 
66 per cent in the therapy groups, a di 
ence which is not Statistically significant. He 

One might question at this point whet ily 
the patients on the waiting list should aoe 
be thought of as “untreated.” In a aan F 
course, simply having committed onesel ‘ae 
Participating in psychotherapy, and hav i 
had a reciprocal commitment from a dee 
afford psychotherapy, even though not z E, 
mediately, represents a breaking of the n dy 
rotic circle. A force for change has alee 
been introduced. In addition, the initial is 
terview and the psychological testing m f 
themselves be therapeutic events, since e 
ing such sessions the patient makes sora mae 
forts to confront himself and his probe 2 
more objectively than he has in the pea 
Moreover, the focus of the intake inten 
at the Kaiser Foundation clinic was gen the 
ally upon realistic questions concer ah n 
patient’s situation and possible courses 9 s” 
tion, so that even the waiting-list etree 
might well feel that a realistic review of t on 
situation had been achieved, that an imp by 
tant decision to change had been made ye 
them, and that in general they had obta! W 
more control over their own lives, As the Sie 
tistics in Table 2 indicate, these changes for 
slight and are not statistically significant, a); 
the clinical scales (with the exception of bp 
but there is some change. From a me 
logical standpoint, it may be suggested fu- 
other control groups should be added Ae se: 
ture studies, since the psychological fac ee 
involved in being on a waiting list are ther 
Selves possibly determinative of changes 
Psychiatric condition. 


ain 


| 


Changes in Patients With and Without Therapy 


Table 3 


Comparison of Treatment and Nontreatment Groups in 
Terms of Discrepancy Scores (ku —kt) 
on MMPI Scales 


Individual psycho- Group psycho- 
therapy vs. therapy vs. 
nontreatment nontreatment 
Diff. Diff. 

between between 

mean dis- mean dis- 

ao crepancy crepancy 

cale scores CR scores 

ee 130 1.06 ist 131 
poe 187 0.75 145 1.10 
ne 401 2.44" 216 1.58 
ree 0.73 0.30 0.50 0.25 
Re, 552. 4.75 0.16 0.06 
7 Hy 0951.49 0.97 045 
ae 4.00 1.41 2.38 1.08 
ke 0.22 125 ois 015 
nee 296 111 154 0.70 
ies 351 0.68 314 147 
v 109 o4 1.83 0.89 
na 0.82 0.64 0.40 0.36 


emia oe 


Yi 
Difference statistically significant at .05 level- 


a The question remains, is there significantly 
Ore change with regular and formally de- 
ped Psychotherapy than without it? The an- 

Swer is Provided in Table 3, which presents 
Omparisons of the treatment and nontreat- 


me groups in terms of discrepancy gore, 
en the amount of discrepancy consequen 
d from the 


Upon Nontreatment is subtracted ITO". i 

Ount consequent upon either individua 
Psychotherapy or group psychotherapy, what 
npoains is rarely a discrepancy of such anen 
atude as to be statistically significant. = 
aly Comparison which did yield a PAI 
“ant difference in discrepancy scores was 


°Mparison of the individual Psycho a 
8toup with the nontreatment group on tae bs 
Scale; and, in that instance, the pie 
Zas large because in the case of the fe (de. 
ent group the discrepancy was PES A 
Seleli K scores); while i Hepna Rn 
Psychotherapy group the discre aae hor: 
Negative (rise in K). For the most Paie same 
‘ver, the changes tended to be 0 ees prtent 
itection for treatment and nO tT 
8toups, and of almost equal magnitut. 
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Summary 


The results yielded by this study may be 
summarized as follows: 

1. The mean pre-post MMPI scores of pa- 
tients undergoing both group and individual 
therapy showed significant improvement on 


symptom scales. 
2. Patients who decided to enter therapy 


but who were required to wait for treatment 
showed some MMPI improvement during the 
waiting period, primarily in prognosis. 

3. The therapy patients did not improve 
significantly more than did the waiting-list 


controls. 

4, These results suggest that the use of 
“waiting-list” controls in investigation of 
changes in therapy may be complicated by 
therapeutic factors involved in the initial in- 


take evaluations and decisions. 
5. The use of additional “nonwaiting-list 


controls” is suggested for future investiga- 
tions on the effect of psychotherapy. 


Received November 3, 1954. 


References 


-strength scale which predicts 


n, F. An ego 
eee J. consult. Psy- 


response to psychotherapy. 
chol., 1953, 17, 327-333. 

2. Barron, F. Ego-strength in normal men as meas- 
ured by an MMPI scale. Paper read at the 
West. Psychol. Ass., 1954. Library of the In- 
stitute of Personality Assessment and Research, 
Univer. of California, Berkeley. 

3. Eysenck, H. J. The effects of psychotherapy: an 

-e evaluation. J. consult. Psychol, 1952, 16, 319- 
324. 

4. Gallagher, J. J. MMPI changes and client-cen- 
tered therapy. J. consult. Psychol, 1953, 17, 
334-338. 

5. Kaufmann, P. Changes in the Minnesota Multi- 
phasic Personality Inventory as a function of 
psychiatric therapy. J. consult. Psychol., 1950, 
14, 458-464. 

6. Leary, T., & Coffey, H. The prediction of inter- 
personal behavior in group psychotherapy. 
Group Psychother., 1954, 7, 7-51. 

7. Mosak, H. H. Evaluation of psychotherapy: a 
study of some current measures. Unpublished 
doctor’s dissertation, Univer. of Chicago, 1950. 

8. Rashkis, H. A., & Shaskin, D. A. The effects of 
group therapy on personality scores. Amer. J. 
Orthopsychiat., 1946, 16, 343-349, 

9. Rosenzweig, S. A transvaluation of psychotherapy 
—a reply to Hans Eysenck. J. abnorm. soc. 
Psychol., 1954, 49, 298-304. 


Journal of Consulting Psychology 
Vol. 19, No. 4, 1955 


Brief Psychotherapy and Enuresis’ 


Daniel H. Harris, Richard W. F irestone, and Carl M. Wagner 
Marine Corps Recruit Depot, San Diego, California 


The present study derives from the premise 
that nocturnal enuresis in adults is primarily 
psychogenic in origin. Supporting this was the 
observation that the psychological climate in- 
duced by military training could often be 
meaningfully related to variations in the 
enuretic symptoms of Marine recruits, This 
experiment investigated the effect of a psycho- 
therapeutic situation created prior to training 
on the adjustment of such recruits. The spe- 
cific hypothesis tested was: a significant re- 
duction of admissions to the psychiatric ob- 
servation ward in which enuresis is a factor 
will result if, during the regular screening 
Procedure, enuretics receive brief psychother- 
apy combining recognition and acceptance of 
their problem with specific suggestions for 
Overcoming the habit. 

Two hundred recruits (ages 17 to 27) en- 
tering training with an admitted history of 
enuresis during the previous five years were 
randomly assigned to an experimental group 
(N = 100) or control group (N = 100). The 
two groups did not differ significantly in age, 

1 Opinions or conclusi 
are those of the authors, 


ment of the Navy Department. 

An extended report of this study may be obtained 
without charge from Daniel H, Harris, Marine Corps 
Depot, San Diego, California, or for a fee from the 
American Documentation Institute. To obtain it 
from the latter Source, order Document No. 4592 
from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 


$1.75 for micro- 


t 
education, intelligence, or degree of appare? 
neuropsychiatric involvement. A 

F AEA aeay subjects, the regnar ra 
chiatric screening interview was expande! at 
a brief psychotherapeutic session designe 
relieve anxiety related to enuresis by n of 
of a permissive and reassuring discussio E 
the symptom, plus a focusing of positive aa 
tivation around some plausible Lg in 
suggestions for overcoming the habit. E 
the control group had only the regular Me in 
ing interview. Subsequent contacts wit etern 
either group followed a standardized p were 
in which further attempts at therapy 
avoided. taa lON 

On the basis of a rigid set of admissi 
criteria, 20 control Ss were admitted . om! 
psychiatric observation ward prior to a 
pletion of recruit training, while ony ae 
were admitted from the experimental ce 
Chi-square analysis revealed this cae 
be significant, supporting the hypothes 
better than the .02 level of confidence. 
parently the therapeutic situation i 
this study was instrumental in substan 
reducing the number of ward admission 

Among a third group of recruits =e t 
cealed histories of enuresis at beanie fe oo 
later proved to be enuretic, the ward a ex 
sion rate was five times as high as that n the 
perimental and control groups combine revel 
difference being significant at the .01 the 
This finding gives additional support t° 
main hypothesis. 
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When the proponents of one viewpoint of 
Psychotherapy criticize the studies of any 
p uey school of thought, the criticisms tend to 

all in one or both of two classes: (a) the con- 
ay and relationships studied are unimpor- 
ant or have only minor relevancy; (b) the 
Conditions of measurement are such as to 
Preclude proper investigation of the variables 
under consideration. 

The study reported here is 
of investigations of psychoth 
esses (1). In these studies we have attempted 
to select variables which have theoretical and 
Practical relevance over a wide variety of 
therapeutic approaches. F' urthermore, we have 
Concerned ourselves intensively with issues of 
Measurement. In these ways OUY eventual 
80als of hypothesis testing can, WE hope, com- 
Municate beyond the narrow barriers of school 


Partisanship. 
t One of the major activities of the psycho- 
therapist in the course of treating his patient 
Is to engage or avoid engaging in interpretive 
ehavior (5,9). Collier has presented a rather 
ull discussion of the interpretive continuum 
as it relates to psychoanalytic and nondirec- 
tive therapy (2). Like Collier's study (3), the 
Present paper reports the development of 3 
Scale for the measurement of @ therapist’s 
depth of interpretation. We felt, however, that 


b * This paper is part of 
I. a research grant M-51 
g arite of Mental Health 

Health, United States Public 


authors are indebted to Dr. R. r 
Eo for 
ays, Mr. Z. Sperber, and Miss Ja V Williams 


eir assistance in various aspects of the researc a 

2Now at the University of Rochester, Rochester, 

ew York. 

® Now at the National Institut 
Bethesda 14, Maryland. 


one of a series 
erapeutic proc- 


an jnvestigation supported 
6 C-2 from the National 
of the National Institutes 


Health Service. 


of Michigan 


the immediate utilization of such scales for 
hypothesis testing would be premature. In 
studies of psychotherapy, as in all studies in- 
volving ratings and codings, interpretation of 
data is limited by our understanding of the 
conditions of data collection. So long as these 
conditions are not understood and accounted 
for, investigators will arrive at discrepant re- 
sults, and will question one another’s data. 
Typical among measurement issues raised 
with regard to variables in psychotherapy are 
tions concerning context, unit size, and 
data presentation. Each of these 
e focus for sometimes naive, 
cated criticism of published 
studies. For example, we may consider the 
kinds of statements that are apt to be made 
in discussions of research in psychotherapy: 
“The failure to provide judges with informa- 
tion as to what has gone on previously in 
therapy, makes their judgments of the be- 
havior in question meaningless” (the prob- 
Jem of context); or, “What is really meant by 
the concept is not any specific, momentary 
behavior, but rather the over-all effect” (the 
problem of unit size); or, “The judges would 
have to have movie films (or recordings) in 
order to really evaluate the behavior” (the 
problem of mode of presentation). 

The specific definition of depth of inter- 
pretation used in the present series of studies 
is: “Any behavior on the part of the thera- 
pist that is an expression of his view of the 
patient’s emotions and motivations—either 
wholly or in part—is considered an interpre- 
tation. A patient has varying degrees of aware- 
ness of his_ emations“and motivations. Depth ` 

__of-interpretationaiscn escription of the rela- 


ques 
method of 
issues becomes th 
sometimes sophisti 


e of Mental Pa gi edionship ‘bet yegn cae iew expressed by the 
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therapist and the patient’s awareness. The 
greater the disparity between the view Bs 
pressed by the therapist and the patient’s 
own awareness of these emotions and motiva- 
tions the deeper the interpretation.” The defi- 
nition is compatible with both psychoanalytic 
and nondirective viewpoints as expressed in 
the literature (5, 9) and is sufficiently broad 
to encompass the data of a variety of thera- 
peutic approaches. 

Acceptance of the definition of interpreta- 
tion as an interaction of patient and therapist 
has certain implications for the measurement 
operations discussed above: 

(a) With regard to unit size: Since we 
could see no firm basis for an a priori choice 
as to unit, we felt that a comparison of ex- 
tremely divergent sizes would best indicate 
any effects that might go with variation in 
size. 

(b) With regard to method of presenta- 
tion: Since the variable of depth of interpre- 
tation seems in the main to deal with the re- 
lation between the content of the therapist’s 
behavior and the content of the patient’s 
awareness, we should expect little or no dif- 
ference in the evaluati 
the typescript of an 
with using the actual 


(c) With regard to context: Clearly the in- 
terpretive value of a therapist’ 


or no correlation wi 


th ratings obtained when 
the necessary info 


rmation is available, 


Development of Rating Scale 


Following Thurstone’s 
appearing intervals 


of fourteen 
ed graduate stu- 
8Y, each with at 


rience jn Psycho- 
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therapeutic practice. Eleven undergraduate 
students in the first course in psycholom 
composed the “naive” judges. Judges ke 
disparate experience were used in hope o 
identifying items highly communicable to a 
wide range of possible raters. d 
The importance of taking judge groups ng 
account was demonstrated by the fact the 
the naive judges were significantly more vel 
able and placed significantly more items a 
the deeper end of the scale than did the ex 
erienced judges. fe 
i Seven of the statements had been ones 
nally selected so as not to fit the, ree 
ments of our definition; while descriptive Ae 
therapist activity they did not give any iní a 
cation of patient awareness or of the la 
of the therapist’s activity to the pate 
awareness, e.g., “Questioning designed to oe 
information,” “Therapist suggests thay se 
patient desires to terminate therapy.’ bars 
Seven statements offered an internal chee 
they scaled along with our bona fide se 
ments, the meaning of the resulting E 
would be open to question. None of t for 
“spurious” statements met our criteria 
inclusion in the scale, ned. 
A seven-point graphic scale was oban 
Nine statements were selected to oxen 
Points on this scale. The statements and ae 
scale positions (running from low to hié 
depth) are: 7 
(a) Therapist merely repeats the material 
of which the patient is fully aware (1.1). He 
(6) Restatement of material of which 
patient is aware (1.8). Pe 
(c) Implied focusing with regard to ma 
tial of which the patient is aware (2.3)- wo 
(d) Therapist connects for the patient t ‘ 
aspects of the content of the previous patie 
statement (3.4), the 
(e) Reformulation of the behavior of i 
patient during the interview in a way ae 
explicitly Tecognized previously by patie 
(3.9), 3 
(f) Therapist comments on patient’s bodily 
and facial expressions as manifestations of P 
tient’s feelings (4.4). to 
(g) Use of Preceding patient statement 
exemplify a process that has been building uR 
during an interview and of which the patie? 
is seemingly unaware (4.9). 
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(2) Therapist speculates as to a possible 
childhood situation that might relate to cur- 
Tent patient feeling (5.9). 

(i) Therapist response deals with infer- 
ences about material completely removed from 
the patient’s awareness (6.9). 

In the studies below the definition of depth 
of interpretation and the scale were presented 
with the statement that the nine items on the 
scale “are not inclusive of all possible descrip- 
tions of depth at these points . . . but are 
merely examples of types of things that could 
Occur and where they would fall on the scale.” 


The Conditions of Measurement Study 
Design 


’ Sixteen raters used the scale to evaluate 
Cur therapy interviews, each taken from a 
different case and each involving a different 
therapist. The raters had the same qualifica- 
tions as those of the experienced judges in- 
Volved in the development of the scale. The 
tee sets of measurement conditions dis- 
“ussed earlier were investigated. These were: 
(a) the unit of the interview to be rated— 
e individual therapist response vs. the in- 
€tview as a whole, (b) method of presenta- 
tion of the interview to the rater—typescript 
Vs. tape recording, (c) amount of information 
¥ context given to the rater—the interview. 
be rated with its preceding interview 
Preceding interview condition) VS- only the 
etapist’s responses in sequence from ets 
ĉtview to be rated (therapist only condition). 
he study was designed to control sys- 
‘matically or evaluate the influence of ae 
terviews and practice in the use of ve an a 
time-consuming nature of the e ee 
Not allow complete control of these eee 
relatively great amount of time is 
Ty to read or to listen to @ be considere 
-minute interviews. Also tO lable wit 
Were the number of raters avart and t 
’Ppropriate experience and plies; rapy in- 
number of clearly recorded psychotherap 


€tviews obtainable. r 

A 2x 2 x 2 factorial design y es 
(each of the three variables—m ey waned 
entation, context, and unit size" Trie such 
Over two levels). To form a latin RE Rae 
that each rater rated under each combi 
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Table 1 
Assignment of Raters to Experimental Conditions 


Typescript Recording 
Inter- Re- Inter- Re- 
view sponse view sponse 
Context unit unit unit unit 
Therapist I* vi v I 
only I VI VI IL 
Im VIL VIL, 
IV VIU VOL IV 
Preceding V I I V 
interview VI I pii VI 
Va if Im VI 
VOI IV IV vo 


* Roman numerals represent raters, 


of the experimental conditions in a different 
order than any other rater, and such that each 
combination of the experimental conditions 
was rated but once at each order position 
from one to eight, required eight raters. 
Table 1 presents the eight possible combina- 
tions of the three factors and the assignment 
of the raters to the various combinations, The 
design was replicated, giving us a total of six- 
teen raters. Kogan (7) has noted the advan- 
tages in certain instances of “confounding” in 
the design of psychological experiments. In 
the present instance, confounding of the three- 
factor interaction (Presentation X Context 
x Unit) with the rater differences reduced 
the interviews to four and the time required 
by half.* 

When the interview was the unit rated, only 
one score was obtained from the rater. When 
the response was the unit rated, there were, 
of course, as many scores for each rater as 
there were responses. In the latter case the 
response unit ratings for a single judge were 
averaged to give a rating for the interview as 
a whole, and then mean response unit ratings 
were compared with ratings of interviews as 
units. Regardless of the method by which 


4Among the characteristics of these interviews: 
The settings were a University counseling center, a 
Mental Hygiene Clinic, an out patient clinic and a 
NP Hospital. The hours represented were the 20th, 
40th, 146th and 11th. Therapists were of analytic or 
modified analytic orientation. They ranged in experi- 
ence from less than 1 year to 10 years of therapeutic 


work. 
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these ratings were obtained, they are assumed 
to represent measurements of one aspect (i.e., 
depth of interpretation) of the same funda- 
mental variate (behavior). Although some of 
the entries in this analysis were arrived at by 
averaging a set of ratings of responses, these 
averages are not to be interpreted in the usual 
sense of representing a number of independ- 
ent observations of the fundamental variate. 
They are, instead, meant to represent only 
ratings of behavior arrived at in a particular 
way—the rating of a whole by means of rat- 
ings of component parts. 

Another problem in connection with the use 
of response units was the pertinence of depth 
of interpretation to the various responses in 
an interview. This was resolved by instruct- 
ing raters to rate each unit but to indicate 
those units or responses which they did not 
feel were ratable on this particular scale. The 
ratings to responses so indicated were consid- 
ered as “forced” ratings and were not used in 
computing the means for the response unit 


Table 2 


Analysis of Variance 
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scores nor were they used in computing inter- 
rater agreements in rating. 


Results 


As seen in Table 2, the scale of depth of in- 
terpretation significantly differentiated among 
the interviews at the .01 level. In fact, the 
variance for interviews was about twice that 
attributable to pooled experimental cond 
tions. The experimental conditions were oua 
to be a significant source of variance at t 7 
01 level. Any interview by experimental E 
dition interaction, if such existed, could 20 
be evaluated. Er. 

Variation due to sequences was not sign! 
cant. The difference between raters within ‘ 
sequence was significant at the .05 level. Sieg 
a finding could result from the use by ne 
of different portions of the scale. It need nog 
affect the agreement between raters in the H 
dering of responses or interviews on the a 

Unit size. Since each experimental con a: 
tion represents a specific combination of thr 


Sum of 


a Mean 
Source of variation squares df square t 

Sequences 5.69 7 81 1.89 

Raters within sequences 8.50 8 1.06 2.47* 

Total between raters 14.19 15 

Order .18 3 06 = 

Interviews 12.64 3 4.21 9.78** 

Experimental conditions 15.23 6 2.54 5.80** 
Presentation T 
Context “0 r 30 1f 
Units 13.32 1 2 at 
Presentation X context 42 1 13,32 F 
Presentation X units : 49 42 1.14 
Context X units "20 3 Ez a 

Pooled error 15.51 36 43 l 

Greco-Latin square error 461 12 j 38 

Pooled rater X order interaction, ) 
different sequences 10.90 24 S 45 

Total within raters 43.56 48 j 

Grand Total 57.75 63 

* Significant at .05 level. 


** Significant at .01 level. 
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factors, the sum of the squares and degrees of 
freedom could be broken down into the com- 
Ponent parts. Testing each of the component 
mean squares for the experimental conditions 
against the pooled error mean square indi- 
cates that the difference in ratings due to ex- 
Perimental conditions was primarily the re- 
Sult of one factor, namely, the size of the unit 
evaluated. For each interview the evaluation 
based on the interview unit was “deeper” 
than the mean of the response unit ratings. A 
further study showed that this result was not 
a function of the exclusion of forced rat- 
ings. Apparently the judge’s perception of the 
depth of an entire interview is strongly deter- 
mined by the therapist’s deeper responses. 
his finding is of particular significance be- 
Cause previously many investigators have 
Made the assumption that the rating of an 
entire interview was equivalent to the pooling 
Of a sequence of response ratings within an 
interview in terms of some average rating. As 
Towrer, Hunt, and Kogan note in a slightly 
different context, “the fact that a client men- 
tions one problem ten times and a second 
Problem just once does not necessarily mean 
to the clinician that the first problem is ten 
times as important to the client” (8, p- 259)- 
Method of presentation. It had been ex- 
Pected that ratings of depth of interpretation 
Would not differ when based on a typescript 
aS compared to a tape recording of a therapy 
Mterview. The basis for this expectation was 
u © fact that this variable was, princi a 
Content” variable, that is, that its rating A 
Pended upon the actual words spoken, 
Not upon some other factor such as tone O 
Voice, facial expression, etc. The analysis in 
Table 2 indicates that there is no difference 
n the ratings of interviews under different 
Methods of presentation of the nen 
“Or evaluations of this particular variable, 
then, we can in the future present typescripts 
O our raters and enjoy the practical advan- 
tages stemming from the easier administra- 
ion permitted by this method. 


_ Studies of the effects of inclusion of = er al 
‘ngs, and studies of the reliabilities of es es 
Methods and the cross correlations etree pe 
lend further support to the conclusion : om nl 

ns of depth of interpretation do a As a 
function of these alternative methods of Pr w 
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Context. We turn now to the critical ques- 
tion of context. The concept of interpreta- 
tion, and the specific definition used in this 
study imply that knowledge of both patient 
and therapist activity is necessary for a cor- 
rect appraisal of the interpretive level. If our 
measurements—in this instance ratings—are 
valid, then the removal of the patient re- 
sponses should lead to different results from 
those obtained when the patient responses 
are included in the information given to the 
raters. The analysis of variance presented in 
Table 2 indicates that the expected difference 
did not occur. Furthermore the reliabilities of 
the two methods are comparable, and the 
cross correlations indicate that the methods 
are equivalent. 

As has been noted, such a finding casts 
doubt on the validity of our measurements or 
on the adequacy of the definition of the con- 
cept. A third alternative, however, suggested 
itself. It seemed possible that the raters were 
obtaining information as to the patient’s be- 
havior from the sequence of the therapist’s 
responses. To check on this, a study was done 
in which four new raters and two of the in- 
terviews were used. 

In this study all ratings were made on the 
basis of typescript and with response as the 
unit. Each rater evaluated one interview with 
only the therapist responses in sequence pres- 
ent (this is the therapist only context of the 
earlier study) and the other interview with 
only the therapist responses present but in 
random order. The order of presentation of 
interviews and of experimental conditions was 
systematically varied. 

There is no difference in the mean response 
unit ratings between ratings based on sequen- 
tial therapist only information and ratings 
based on randomized therapist only informa- 
tion. However, the analysis of interrater re- 
liability coefficients and the cross-context cor- 
relations, suggests that marked differences do 
exist between the sequential context and the 
random order context. The reliability coeffi- 
cients for sequential order were .64 and Ji, 
while those for random order were .49 and 
— -03. On the other hand, none of the eight 
paced a differ significantly 

x 0 ging from — .19 to .15 with a 
median of — .05. In other words, while raters 
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might agree within the random order condi- 
tion, there was no evidence of significant 
agreement across conditions. These data sug- 
gest that the sequence did give the judges 
enough information about what the patient’s 
behavior may have been to allow them to 
make ratings equivalent to those of judges 
who actually had read the intervening pa- 
tient response. Randomizing the sequence of 
therapist responses probably randomized the 
judge’s hypotheses about the level of aware- 
ness demonstrated by the intervening patient 
behavior. However, this conclusion was based 
on a small number of correlations, and one of 
the two correlations under random order con- 
dition was almost as high as those observed 
under sequential order. Therefore two more 
judges were asked to rate the therapist re- 
sponses in this interview under the same two 
conditions. The four additional sequential or- 
der correlations ranged from + .81 to R52; 
confirming our previous finding. The four ran- 
dom order correlations were — 03, — .06, 
— .08 and +.24. The ten additional cross 
correlations ranged about zero, some, how- 
ever, reaching the level of statistical signifi- 
cance. These additional data allow us to state 
with increased confidence that judges were 
attempting to judge therapist’s depth of in- 
terpretation as it was defined. 

In a further effort to generalize our findings 
the basic four-judge design was applied to two 
new interviews. We were surprised to find that 
the sequential order, random order and cross 
correlation were all at the same level, median 
correlations being -+ 57, +.61, and + 153; 
respectively. Our present impression is that 
the therapist style in these interviews (early 
counseling interviews) will explain the result. 
Therapists sometimes recapitulate to the pa- 
tient what he was saying or doing before pre- 
senting an interpretive reaction to the pa- 
tient’s activity. Thus, information would be 
available to a judge no matter where in the 
sequence the therapist response was located. 
As a first check on this impression a count 
was made of the number of words used by 
therapists in the two studies. As expected, 
therapists in the interviews used in the latter 
study tended to make longer responses. The 
information-bearing characteristics of thera- 
pist? communications are now being ana- 
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lyzed and further sequence studies are planned 
to test these ideas. 

Reliability and validity. It might be argued 
that the failure to find differences in the main 
study due to context is due to the low a 
liability of our measure. One of the usua 
methods for determining reliability of ratings 
is by means of agreement between raters. Al- 
most all the reliability coefficients based 0 
the ratings of two raters working on the same 
interview under the same context and pres- 
entation conditions were statistically signifi- 
cant. The median coefficient in the main study 
was .40. Reliabilities of this order are disap- 
pointing and at first glance an obvious an 
gestion would be to dispense with the sca i 
It must be considered, however, that wha 
is represented by these numerical values a 
analogous in test development to item a 
ability. For example, we computed the F 5 
ability of response unit ratings of depth Ss 
one of our interviews on the basis of a i 
response segment. The means of the rating? 
for the first ten responses, second ten a 
sponses, and so on, were obtained for tW 
raters, and these means were then correlate: 
Interjudge agreement was now .74 compar” 
to .36 for single response units. As in a pe 
we may increase our reliabilities by incre4 
ing the number of items, each of which may 
have rather low reliability. The problem, bo 
ever, remains: Can we study single response 
rather than summing or averaging ove" nat 
sponses? Here too, we may make use of te 
theory. Where one is interested in individu 
items, where any one judgment may be of A 
reliability, as in opinion surveys, accuracy i 
measurement can be attained through ! a 
creased sampling. We have, for examp a 
found that when we pool the ratings of b 
number of judges on individual items, We Bs 
tain almost perfect correspondence (rhos 
‘89, .94, and .93) with the ordering arrives 
at by combined judgments of other judg 
using other methods, such as rankings & 
method of similarities by triads (4).° 


e 
6 Further confirmation of the usefulness of T 
scale appears when reliability of individual ree 
items is estimated by the Horst formula (6)- ove 
sis indicates that agreement among the judges Ait. 
counted for from 39 to 62 per cent of the total V 
ance among items. 
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Considering the statistical significance of 
Most of the coefficients, the relatively infer- 
ential and complex nature of the variable be- 
ing rated and the fact that none of the raters 
had any training in the specific use of the 
Scale, the extent of interrater agreement for 
depth of interpretation is far from disappoint- 
ing. The certainty with which the four inter- 
views could be discriminated gives substance 
to this conclusion. Further, if our measure- 
ments were sufficiently reliable to differentiate 
Interviews and unit size, it follows that our 
failure to find differences between the preced- 
ing interview and therapist-only context con- 
ditions cannot be attributed’ solely to errors 
I measurement. 

aving considered reliability, we may now 
Summarize our findings concerning the va- 
idity of the scale. The later studies indicated 
that the initial test of validity, based upon a 
comparison of preceding interview with thera- 
Pist-only context conditions, was not critical. 
es tther, these later results do provide evi- 
meee for validity. Frequently, in the meas- 
prement of variables such as the one pre- 
an here, validity is not evaluated until 
a €nce is available of success in predicting 
; ationships with other variables. We have 
fi “strated in this paper that it is possible to 
E eck on validity of measurement by examin- 
t 8 the consistency of the measurements with 
© definition of the variable. 


Summary 


Th this paper we have illustrated not only 
W different procedures of measurement lead 
iffering perceptions of the therapeutic 
Process, but also how varying the measure- 
ent conditions can, in certain instances, €n- 
able a check on the internal validity of the 


ho 


253 


concept under investigation. Three of the 
conditions of measurement—method of pres- 
entation, unit size, and context—were varied 
in presenting psychotherapy interviews to 
raters. Ratings were of the depth of a thera- 
pist’s interpretations to the patient and were 
based on a seven-point scale. The four inter- 
views used were clearly discriminated. Varia- 
tions in unit size and in certain conditions of 
context led to changes in ratings of depth. 


Received October 22, 1954. 
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Responses to Imagined Auditory Stimuli as 
Compared to Recorded Sounds’ 


David R. Stone 
Utah State Agricultural College 


The use of auditory stimuli as a source of 
useful data is in the exploratory stage. Pre- 
liminary work has indicated that such an ap- 
proach can produce useful diagnostic signs, 
both for clinical and developmental analysis. 

The work to date has centered around two 
major trends, (a) presenting sounds in single 
order, requiring free associative response to 
the sounds in turn (1), and (b) presenting 
the sounds in sets, asking for multiple asso- 
ciation to the sounds taken as a whole (2). 

The present study followed the latter trend, 
and was an amplification of the multiple- 
association technique as applied to imagined 
sounds, rather than to actual recorded sounds. 
The sounds were described verbally, in con- 
trast to being played. 

In the recorded version, the subjects (220 
college students) heard a bird chirping, a 
train coming from a distance which comes 


closer until a crashing is heard, and a trumpet 
fanfare. 


The subjects for the 
sounds were 74 stude: 
chology class. The ins 


In a moment I will describe three s 
you hear the descriptions, 


study of imagined 
nts in a general psy- 
tructions were: 


ounds. When 
write a story in which you 

1An extended report of this stud: 
tained without charge from David 
State Agricultural College, Logan, 


; Make checks 
payable to Chief, Photoduplication Se: 
of Congress. 


use the sounds as described. Tell what has led ne 
the sounds, what is happening, and how it tu A 
out. You will have five minutes. For the first s 
imagine that you hear a bird chirping. Por ae 
second sound, imagine that you hear a train es. 3 
in the distance. You hear the faint sound Ae 
whistle. Gradually it gets closer and closer. a 
you hear a terrific crash. For the third sound, i 
agine that you hear a trumpet fanfare. 


At the end of four minutes, the subjects 
were told of the time and advised that he 
would have one minute to complete the! 
story by telling how it turned out. er 

In terms of length, order of sounds, situ i, 
tions described, characters, sound desm 
tions, and outcomes, the responses to imas 
sounds were either similar to the recor 
version, or included them plus adti 
elaboration. The use of imaginary (verba 
described) sounds seems as productive, thoug 
less structured than the recorded stimuli. a 

Perhaps a more subtle analysis would a 
veal differences not now apparent. It is ae 
sumed at present that the association d 
multiple stimuli is a more crucial element y 
these responses than whether the audito 
stimuli are imagined or real. 


Brief Report 
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Clinical Statements as Scientific Propositions 
and Social Decisions”? 


Frank M. du Mas 


Montana State University 


“Tom is a neurotic.” “Dick is to remain at 
ome under the continuing care of his par- 
ents until further study of his case can be 
made,” “Harry is to be committed to the 
State institution for mental defectives.” These 
Statements, though overly simplified and out 
of context, are the kinds of statements clini- 
cal Psychologists must make in their routine 
Professional work. Each statement is different 
sont every other statement in certain re- 
“pects. The statement about Tom is a more 
or less Straightforward statement of a matter 
af fact. The statement about Dick is a social 
£cision to withhold positive action. The state- 
ment about Harry is a social decision to 
Mitiate a definite course of action. The clini- 
ral Psychologist is an applied scientist and 
these statements are relevant to the applied 
Part of his work. He is a scientist operating 
within the confines of his social matrix and 
© is constrained to obey administrative 
Protocol, the laws of his society, and to make 
cisions about a patient which may radi- 
ally change the patient’s way of life. It is 
not a question of whether or not a clinician 
Wants to make these kinds of decisions. He 
Must, if he is to work effectively, in a social 
"stitution such as a hospital. , 
But the clinician is also a scientist. In his 
Endeavor to push back the frontiers of knowl- 
edge, he frequently resorts to theoretical 


* This article is a major revision of a paper read 
at the 1954 Convention of the Midwestern Psycho- 
gical Association. 

? The ideas presented here are relevant to all ap- 
Plied Sciences. The discussion is pointed at one oe 
ticular field, clinical psychology, in order to simp ify 
the discussion. An understanding of our ideas in one 
applied science should easily transfer to other ap- 
Plied sciences. 


analysis in his study and construction of 
theoretical systems which organize and inte- 
grate his field. When he does this, he turns to 
deductive logic in order to facilitate his theo- 
retical work. He often restates an inductive 
generalization as a postulate in a deductive 
system. Then, as in all theoretical work, he 
operates within a formal system and the rules 
of the game are not quite the same as the 
rules appropriate to inductive empirical sci- 
ence or the rules of society. 

It seems, therefore, that the clinician is 
concerned with statements in three domains: 
formal, empirical, societal. What is the ap- 
propriate logical frame of reference to use in 
evaluating the validity of statements in each 
of these domains? Since, as we shall show, 
eminent authorities give quite different an- 
swers to this question, let us refine the issues, 

One widely held point of view is well stated 
by Ayer: 


Like Hume, I divide all genuine Propositions into 
two classes: those which, in his terminology, con- 
cern “relations of ideas,” and those which concern 
“matters of fact.” The former class comprises the 
a priori propositions of logic and pure mathematics, 
and these I allow to be necessary and certain. : 
That is, I maintain that the reason why these propo: 
sitions cannot be confuted in experience is that they 
do i“ make any assertion about the empirical 
world, but simply record our determinati 
u mination 

symbols in a certai ine 
Pe cia of fact, on the other hand, I hold to be 
ypotheses, which 

a a 4 can be probable but never certain 

» P- 31). 


Stated differently, what Ayer is saying i 
that formal propositions may be EE, 
reference to a 2-value logic, that is any f i 
mal proposition is either true Si talee Tn 
probability terms, the probability of any tan. 
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mal proposition being true is either O or 1. 
Empirical propositions, however, can never be 
certainly true or certainly false—they can 
only be probable. That is, an empirical propo- 
sition has a truth value which may be repre- 
sented by a point in a truth continuum. In 
probability terms, the probability of an em- 
pirical proposition being true is always greater 
than O but less than 1. The truth (or prob- 
ability) continuum implies that a multivalue 
logic is necessary for the evaluation of em- 
pirical propositions because a continuum con- 
tains an infinite number of Possible points or 
truth values. 

Another point of view maintains that it is 
possible to evaluate a Proposition about an 
object, person, or event as either certainly 
true or certainly false, This point of view is 
implicit in the writings of Allport: 


The truth of the matter sı 
quent has either 100 
a repeater or 100 per 
(2, p. 156). 


eems to be that this delin- 
Per cent certainty of becoming 
cent certainty of going straight 


In another source Allport states: 
Indeed, if we believe in determinism at all, his (the 
Parolee) chances are either zero or 100: he is bound 
to succeed or else 


to violate... and (ideography) 
will bring your prediction . . | to a 100% certain 
individual prediction (1, P. 17) 


Others agree wit 


h Allport. Snygg and Combs 
state: 


Far from being incons; 


fı istent, behavior becomes char- 
acterized by complete 


Predictability (4, p. 58). 


Snygg and Combs (4, p. 437) affirm their 
agreement with Allport and include a quota- 


probability, they say 
empirical propositions is either 0 or I; 
These representatiye quotations raise cer- 


eed to be answered. 


ference is appropriate 
to formal statements? To empirical State- 


ments? To societal statements? How many 
and what kinds of logical frames of reference 
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Table 1 


Logical Frames of Reference and Their Applications to 
Specific Clinical Statements 


Relations 


Truth values* Applications 
I O<p<1 All clinical statements 
u (F) (T) Formal propositions 
m p=0,1 Formal propositions 
IV O<p<i1 Empirical propositions a 
V (F) (D) (T) Subjective social decisio 
withholding action _ A 
VI O<F|D|T<1 Objective social decision: 
withholding action | E 
vi (F) (T) Subjective social decision : 
action y can 
VU O<F|T<1 Objective social decis 
action 


* Parentheses 


artical Aesi 
represent discrete truth values; vertical 
cuts in the truth 


or probability continuum. 


are required by the clinician? Can a uaia 

Systematic integration be made of the seve 

logical frames of reference? Fe 
Let us attempt to answer these questio 
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5 is 

The most general model of our iden 
shown in Table 1, relation I. It states fi 
for any proposition the probability, 2, nates 
being true is some value equal to or a 
than zero and equal to or less than e 
Classical logic holds, however, that ne 
two truth values, i.e., false, F, or true, how 
shown in Table 1, relation IT. We know oe 
that relation II is relevant to formal Pl 
sitions only. But relation I implicitly con ge 
relation II since by simple translation ie 
relation III. That is, the limits of the rea 
or probability continuum suffice for the 
values of classical Aristotelian logic. En 

But no empirical proposition is ever td 
tain, that is, p can never be O or 1 for oat 
Propositions because (a) there always Se aa 
to be error. in human observations, (2) ab- 
empirical Proposition is ever regarded 7 pee 
solutely true or absolutely false by all we 
competent to judge, i.e., by all scientist a 
all times, and (c) all possible oes re 
never have been and never will be ma 2 m5 
garding any empirical matter. Item c Eo Sire 
to be true because (i) positive or nea en 
Stances may occur in the future and (ii) I 
in a specified time interval in which obs 
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tions are made, all possible observations are 
not made nor do all scientists at that time 
make observations of the specified phenome- 
non; therefore, negative or positive instances 
pu occur in the present, could have oc- 
os in the past, and could occur in the fu- 
a S, Hence, that part of relation I which is 
ieee ‘late to empirical propositions is given 
y relation Iv, 
ee the practical world of affairs, instances 
nstantly arise about which the clinician 
hee oD ostpone judgment or opinion until 
o ES obtained more information, made more 
wei e ans; consulted with others, and 
Tsi a the evidence before he makes a diag- 
ates ; €cides on appropriate therapy, or initi- 
ae ae of action. When such instances 
analy the clinician often makes a subjective 
cn. of a patient’s case history, test re- 
» Present behavior, etc. For example, in 
a Case of Dick the clinician’s judgment was 
action Done or withhold a definite course of 
is 4 5 The empirical proposition on which 
“Dic €cision rests might be something like 
Socia] S Psychotic.” At the time a subjective 
tion « €cision had to be made, the proposi- 
er ick is psychotic” remained in doubt. 
eea tes, therefore, a 3-value logic: false, 
Priati ul, and true. Relation V is the appro- 
Stan e logical frame of reference in this in- 
of he However, when an acceptable estimate 
tion aa be calculated, three intervals of rela- 
Valu V can suffice for the three discrete truth 
es of relation V. The calculated estimate 
Would permit an objective social decision 
Withhy Made that definite action should be 
: eld in Dick’s case if p fell within the D- 
terval of relation VI. ae 
c 3 Seems obvious that a 3-value logic is a 
Utious guide to decision making in a practi- 
Al world of affairs. It permits us to postpone 
€cision until we are surer of the factors 1m- 
Olved and their relative weights. But sooner 
T later the clinician is forced by the demands 
the society in which he lives and works to 
Gok another kind of decision. That is, s0- 
ae l demands often force him to say NES 
T “no”; this will work or that will not work. 
not Must decide whether a person was or was 
Morally responsible at the time of a crime, 
ether a patient is or is not a schizophrenic, 
Whether a person is or is not to be committed 
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to a mental hospital, whether a person will 
or will not violate his parole, whether a pa- 
tient is or is not to be released from the hos- 
pital, etc. The clinician must make many 
decisions of an “either-or” nature. The state- 
ment regarding Harry is of this sort. 

At first glance it may seem that a 3-value 
logic also would be appropriate to a social 
decision initiating a definite course of action. 
But there are serious theoretical as well as 
practical limitations involved. Situations often 
arise where “close” decisions have to be made. 
The D-category of relation V or the D-in- 
terval of relation VI may be so wide that a 
proposition must remain forever in doubt. 
His files would become full of- unresolved 
cases. Before long, social pressures (adminis- 
trative, parental, legal) would be brought to 
bear on him to make definite decisions re- 
garding these cases. 

The empirical propositions upon which the 
statement about Harry rests is “Harry is a 
mental defective.” The social rule, say, is 
that all those classified as mentally defective 
must be committed to the state institution for 
mental defectives. The clinician may study 
at great length all available information re- 
garding Harry and then make the subjective 
social decision that Harry is a mental defec- 
tive and, therefore, must be committed to the 
state institution. Relation VII is applicable 
here. However, when the clinician can calcu- 
late an estimate of p, he may define two 
intervals of relation IV and relation VIII re- 
sults. Relation VIII is useful in making ob- 
jective social decisions which initiate a defi- 
nite course of action. 

The preceding development indicates that 
of the many possible frames of reference (1- 
2-,3-,..., n-value), there are three which 
have particular relevance to clinical state- 
2 An rae or 2-interval, 3-value or 3- 
nterva i 
Gaines ‘hem ali ae Ta goer that 
continuum, Probability 


Summary 


The clinical psychologist must serve two 
masters: science and society. His professional 
statements will fall in three domains: formal 
empirical, and societal. Statements with ae 3 
cietal significance are often implictily based 
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upon empirical propositions. Each formal or 
empirical proposition can be regarded as hav- 
ing a certain probability, p, of being true. 
The general model is the truth or probability 
continuum: 0=p=1. Clinical statements 
about a patient are directly or indirectly em- 
pirical propositions. 

A clinician has two kinds of social decisions 
to make about a patient: to withhold a course 
of action or to initiate a definite course of ac- 
tion. His subjective social decisions require a 
3-value logic (false, doubtful, true), when- 
ever he wishes to withhold action. His subjec- 
tive social decisions require a 2-value logic 
(false, true) when he must initiate a definite 
course of action. He can, however, make ob- 
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jective social decisions whenever an estimate 
of p can be calculated. The 3-value and 2- 
value logics may then be regarded as 3-inter- 
vals and 2-intervals respectively of the prob- 
ability continuum. 


Received December 8, 1954. 
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Delayed Gratification and Ego Development: 


Implications for Clinical and Experimental 
Research 


Jerome L. Singer 
Franklin D. Roosevelt VA Hospital, Montrose, New York 


Since its initial delineation in Freud’s The 
Interpretation of Dreams (13), the concept 
of delayed discharge has played a pivotal 
tole in the psychoanalytic theory of ego de- 
velopment and the psychology of thinking. 
Little attempt has been made, however, to 
explore some of the implications of this con- 
cept and to deduce testable hypotheses or to 
Survey Systematically some of its parameters 
in relation to views held by other theorists in 
Psychology. The last decade has witnessed 
a marked increase of interest in ego func- 
‘Ons and a consequent coalescence of psy- 
choanalytic theory and general psychology. It 
Now seems possible to attempt at least an ini- 
me Survey of the scientific usefulness and va- 
'dity of Freud’s view of delay. In the present 
Paper the concept of delay will be related to 
ki € views of other theorists, relevant empirical 
Vidence will be cited, and some implications 
Ca for further experimentation and practi- 

utility will be suggested. 


Origins in Psychoanalytic Theory 


aoe distinction between primary and sec- 
ary processes in mental functioning has 
een described by Jones (22) as one of 

Teud’s most profound formulations. The 
Shift from the chaotic, associative, diffuse, 
a “syncretic” character of primary-process 

inking to the more synthetic, goal-directed, 
reality-oriented secondary process involves as 
à key step the enforced delay or deferment of 
8ratification (13). As Freud described the se- 
quence of thought development, the gradual 
internalization of the delaying mechanism 
Provided the clue to the emergence of the re- 


ality principle (11). The arousal of a need- 
tension pressing for discharge results in the 
infant in a restless discharge of motor ac- 
tivity which eventually subsides upon con- 
tact with the satisfying object, e.g., bottle or 
breast. When such restless motor activity has 
been repeated frequently in association with 
the satisfying object, the absence in reality 
of the object will lead to its hallucinatory 
representation as soon as the motor innerva- 
tion is initiated by the aroused need. This 
step is part of the primary process and re- 
flects the operation of the pure pleasure prin- 
ciple. It can be seen clearly in evidence in the 
autistic perceptions of psychotics, wish-ful- 
filling dreams, and hallucinatory food re- 
sponses of starving castaways. Cathectic en- 
ergies are still mobile and pressing for 
immediate discharge at this stage; hence, the 
ease with which things can stand for other 
things associated with them only by spatial 
or temporal contiguity. Chaplin’s movie, The 
Gold Rush, portrays this most acutely and 
humorously. The little tramp with his jerky, 
restless movements is suddenly transformed 
into a juicy fowl in the eyes of his starving 
companion in the snowbound cabin. 

Freud at no time brought together all the 
steps involved in the shift from the halluci- 
natory representation of the absent drive ob- 
ject to the internalized control of discharge 
through thought process. Nevertheless the 
sequence roughly gleaned from a Sumber of 
different papers seems to involye a gradual 
“neutralization” of libidinal energy through 
identification and incorporation of parental 


figures, transformation of mobile energies 
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into “bound cathexes,” and formation of a 
functional substructure of the personality, 
the ego, whose properties include motor con- 
trol, purposive action, directed thought, re- 
ality-cognition, and various defensive meas- 
ures which organize or segmentalize the 
diffuse innervations arising from basic drives 
(id) (9, 10, 11, 12, 13)2 As early as 1900 
Freud had already suggested that the tran- 
Sition from mobile to bound cathexes made 
Possible the use of small, controlled energy 
expenditures at the behest of the secondary 
process which could serve as signals (13), or 
as he put it later, 
(11). In effect the secondary process substi- 


which it is hoped to attain once more through 
€ stage of motor experiences” 


(13, p. 602 

Subsequent Psychoanalytic theorists have 
not altered Freud’s concepts to any great 
€gree. A brief 


phasized what Hartmann (1 
“conflictual ego-sphere” ani 


1 The meaning of the conce t of f 
cathexes, attributed by Freud to Brae ponad 
completely clear in Freud’s writings, Bier (3) 
seems to have linked “bound cathexes” to “toni 
excitation of nervous tension,” a Phrase of POTR 
chiefly because of its at least superficial similarity to 
Werner’s “sensory-tonic theory of Perception” (58) 
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tasy (denial) or hypercathected thought proc- 
esses (intellectualization) only in their de- 
fensive role. 

The recent work of Hartmann (16), Federn 
(5), Weiss (56), Hartmann, Kris, and Low- 
enstein (17), Kris (24), and Rapaport (39; 
40) has added new breadth to Freud’s con- 
ception of the ego. Rapaport (39), in pat’ 
ticular, has taken an extremely significant 
step in the direction of providing a yee 
atic, scientifically verifiable formulation © 
Freud’s concept of delayed discharge. He 
traces the meaning of this concept at differ- 
ent vantage points: genetic (primary to sec 
ondary Process), topographic (unconscious oF 
Preconscious and conscious), séructural (e80 
functions), economic (mobile to bound or 
thexes or delibidinized energies), and biologt 
cal (adaptive nature of delay and thought). 
By this analysis it becomes possible to a 
more clearly the relationship of the psycho 
analytic theory of thinking to the work i 
others less oriented toward concern with ne 
“neutralization” of instinctual energies be 
more with the adaptive function of yee 1 
in biological survival and interpersonal rela- 
tionships, Rapaport writes, “Thinking & 
plores the possible pathways of action to fin 
the one of least resistance, least danger, 4” 
Steatest directness, while preserving almos; 
intact the energy necessary for motor gaes 
(39, p. 169). This formulation, in essence a 
changed from Freud’s formulations in 19 a 
and 1911, is nevertheless an advance in per 
fying the concept of delay without the Sa 
fusing terminology rooted in Freud’s vague y 
defined cathectic dynamics. Rapaport’s huge 
volume (40) contains a challenging present 
tion of the hierarchical, almost functionally 
autonomous structures of motives and thoug 
processes in the personality structure. 


Other Viewpoints of Delay and Thought 


The belief that conscious thought or fap 
tasy bears some relation to the inhibition n 
an overt motor response directed toward he 
Sort of gratification has appeared in the We iA 
ings of many investigators who worked ae 
or less independently of psychoanalytic t 
ory. The early American functionalists ane 
behaviorists held similar views, even if MG 
except the somewhat extreme and experimen 
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tally unsupported approach that thought was 
nothing more than implicit movement of the 
Speech mechanism. James (21) saw “verbal 
imagination” as the outcome of “suppressed 
articulation” while Dewey (4) claimed that 
Es becomes intensified upon the inter- 
Wn, lon of a usual sequence of motor acts. 

ashburn (55) held a somewhat similar 
> nee view, noting also that consciousness 
Bree associative activity” diminish with the 
te Performance of the act. E. B. Holt, an 
í Y pioneer in the integration of Freudian 
< Cory with the emerging American behavior- 
ism, wrote in 1915: 


al cot is.. . more than the thing thought 
look die ere is active thinking about objects. If we 
nition Na more at the least manifold in which cog- 
to, an ccurs—a living organism in, and responsive 
Ment j a yironment—we see that this further ele- 
eventu: i the active play of motor attitude, which 
forceful Y resolves itself into the less labile but more 
latent phenomenon, conduct. Thus, thought is 
ment Course of action with regard to the environ- 


Page 98), » OF a procession of such attitudes (19, 


ms theories of the behaviorist and func- 
in th Psychologists, while less comprehensive 
theo eir implications than the psychoanalytic 
tal A have led at least to some experimen- 
a arch, These investigations, as summa- 
thoy py Vinacke (54), have indicated that 
‘cit t is indeed accompanied by some im- 
Be Muscular activity albeit by no means 
such been shown to be clearly the result of 
activity, 
ie ore directly related to the psychoanalytic 
°ry, both in influence and implications for 
a Tsonality theory, are views held by im- 
like oF workers in developmental psychology 
Mur 28et (36), Werner (60), Lewin (29), 
i Ry (35), and Luria (30). All of these 
ort ators present empirical data to sup- 
i oa View that thought involves the gradual 
chee of motor response or speech 
- Sion 5 Must be inhibited from overt expres- 
Luria €cause of social restraints or pressures. 
With į (30), for example, describes the change 
us eS age of children from the vigor- 
Sentan E out of a battle scene to its repre- 
Dany i drawing with minimal accom- 
Bee Speech or motor activity. Piaget (36) 
traced the change in children’s language 
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from the egocentric comments in which every- 
thing that comes to mind is pronounced aloud 
without regard for its implications. Socializa- 
tion enforces inhibition of a great deal of this 
speech pattern with the consequent heighten- 
ing of thought activity, conscious and uncon- 
scious. Wolff and Precker (64) describe the 
sequence of development in terms of the 
changing reaction of the growing child in re- 
sponse to being struck: at one stage he re- 
sponds with a direct counterblow, later he 
may verbally abuse the assailant, and finally 
he may completely inhibit or delay overt re- 
sponse but fantasize various countermeasures. 

Perhaps most precise in its derivation and 
fruitful in terms of experimental research 
relevant to the Freudian concept has been 
the work of Werner (58) and Werner and 
Wapner (61, 62, 63). Building in part on 
earlier physiological investigations as well as 
upon Werner’s (60) extensive survey of de- 
velopmental patterns, these writers have for- 
mulated a sensory-tonic theory of perception 
which offers at least the possibility of a more 
precise ultimate formulation of Freud’s view 
of delayed discharge in operational, experi- 
mentally verifiable terms. Werner and Wapner 
describe perception as a function of the dy- 
namic interaction of externally derived sensa- 
tions and pre-existing tonic states in the or- 
ganism. Both sensory and tonic events have 
equivalent functions in the economy of the 
organism and may serve vicariously as sub- 
stitutes for each other. When available en- 
ergy is not released in bodily movement the 
tonicity will express itself in perceptual dis- 
placement, e.g., illusory motion, or, perhaps 
one might add, “movements in the mind’s 
eye,” fantasies of motion. There has been an 
increasing body of experimental literature in 
support of such a theory of the “vicarious 
channelization” (62, 63). As an example, the 
finding reported by Goldman (15) may be 
cited. Subjects responded to the autokinetic 
phenomenon under immobilization, control, 
and heightened motor activity conditions. 
Readiness to perceive motion was greatest 
under immobilization, less under a control 
condition, and least during activity. The the- 
ory and experiments of Werner and his col- 
leagues thus offer a challenging opportunity, 
but their demonstration of blocked motor 
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discharge leading to perception of movement 
must still be related more clearly to height- 
ened imaginativeness if the Freudian con- 
cepts are to be assimilated into their structure. 


Experimental Research with Rorschach’s 
Movement Responses 


Perhaps the most striking possibility for 
operational expression and experimental study 
of the concept of delay has come in research 
with the Human Movement response of the 
Rorschach test. Rorschach (41) in his studies 
of responses to inkblots delineated a type of 
response which involved Perception of humans 
in action (M). He dealt at great length with 


eness or planful- 
ness. In effect, Rorschach, although lacking 


mulating a triadic 


Rapaport’s (40) concern with 


p the delayin 
Capacity of M-type individuals Ver. 


and by Wer- 


Peractive and motorically-phl i 
minded children, a nee feeble 


The heuristic val 
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jects who contrast sharply in Rorschach M 
or in imaginativeness or motor control may 
throw valuable light on the nature of the de- 
laying mechanism. The first experimental ap- 
Proach is chiefly of theoretical interest and 
ultimately may lead to the crucial experl- 
mentation upon whose results the theory of 
delay and thought may stand or fall. The 
second hypothesis, while less crucial theo- 
tetically, has important practical implications 
including the possible development of measur- 
ing devices for the vital ego function of delay 
of gratification and effective use of planning 
and imagination. í 
Turning first to the direct consequences ‘i 
motor inhibition or delay, two experimen’ 
Studies have reported increases in Rorschac 
movement responses of normals following Pi 
riods of motor inhibition, i.e., standing ed 
in awkward postures or voluntary slow wt 
ing (32, 48). Another study has investigattt 
the effects of speeding up or slowing dow 
tempos of Rorschach response and has yl 
the conclusion that production of M respons! s 
is indeed related to tendencies or capacities 
to delay response (45). Further work rena 
to be done but it seems clear that so far mi 
linkage of delay of motor discharge and ne 
tion perception and imagination can be de rk 
onstrated directly in normal adults. No va 
with children has yet been carried out in nat 
direction. A number of studies do suggest re 
the M response emerges most clearly in aa 
groups that are being subjected to the | fe 
striking enforced socialization and moto! 
straint of school entrance (28, 58). It can Ki 
said that Freud’s early formulation of ae 
as arising from delayed gratification and ex- 
charge of minute quantities of energy i” it 
perimental action is certainly consistent W a 
these findings. Whether the subtler ref E 
ments of the theory such as the transform! 
tion from mobile to bound cathexes OF a 
desexualization of energy leading to le 
cathecting of ideational representations oe 
expressed in operational terms and tested ) 
perimentally remains to be seen. Holt ( 


aae? P ;, on- 
has suggested some possibilities in this © 
nection. 


‘on 
The second general avenue of explora” a 

in this field has been more thoroughly par 

ersed because it calls for correlational P 
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cedures rather than direct experimental ma- 

nipulation. Can it be shown that individuals 

Who are given to or capable of extensive im- 

pulse control, deferment of gratification or 

Motor control (apart, that is, from athletic 

skill), will reflect correspondingly both low 

thresholds for perception of motion and 

Sreater imaginativeness? In effect this im- 

Plies that some people do manifest a per- 

Sistent style of coming to terms with their 

environment which involves relative delay of 

immediate reactions to needs or provocative 

Stimulation and employment of planfulness 

ot fantasy in their mode of relating. Ror- 

Schach’s distinction between the introversive 

and extratensive experience-types is clearly 

= example of such a cognitive style and the 
testimony of various experienced Rorschach 
authorities certainly confirms this dimension 

of personality variation (2, 23, 38, 42). 

c Actual systematic investigations have linked 
aracteristic modes of motor reactivity to 
°rschach movement responses (1, 59). It 

schi also been observed that both normal and 

res “ophrenic subjects who yield numerous M 

jan onses are more capable of inhibiting mo- 

logy’ sponses on slow-writing tasks or ae 
sti active and responsive to environmenta 
muli while observed in a waiting room (32, 

» 49), The other aspect of this relationship, 
and Creativity or imaginativeness, cannot 
abaetied directly. Measures such as the 
iby: to transcend objective stimulus ma- 

“rial in thematic apperception stories which 

a 2e considered reasonable approximations 

font fantasy capacity, have, however, uni- 

eo revealed significant correlations be- 
er. ca M and imaginativeness, even with gen- 

47 intelligence controlled (1, 18, 37, 43, 44, 

tate 53). Recently Singer and Herman (47) 
Ported data revealing that schizophrenics 

«fering in g7 responses differed correspond- 

mely in a series of situations tapping motor 

control, imaginativeness, spontaneous motor 
activity, and impulsivity. The results sug- 

Rested that a common factor does indeed 
mk motility, motion perception, and thought 

aS characteristic ego functions. Motor inhibi- 

tion has also been related to cognitive inhibi- 
tion, the tendency to delay verbalization of 
an old association and to rapidly substitute 

à new one (31). Finally, some recent work 
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has shown Rorschach’s M to be related to 
high levels of aspiration, planning ability, 
and impulse control (51). 

It should be noted, however, that none of 
the linkages reported in this section represent 
extremely high correlations. As a matter of 
fact, considerable variability is present and it 
is certain that numerous factors ranging from 
influences of other spheres of ego functioning 
(16) and from direct situational factors in 
the face-to-face subject-examiner relationship 
modify the emergence of the cognitive style 
in question. It may be concluded, neverthe- 
less, that in general the capacity or tendency 
to delay response or inhibit motor discharge 
appears to be a characteristic adjustment of 
many persons and it is linked in them with 
tendencies to be sensitive to movements on 
ambiguous forms or to engage in fantasy ac- 
tivities with relative ease. 


Some Genetic Considerations and 
Clinical Implications 


Accepting at least temporarily the last con- 
clusion, what can be said of the way in which 
these characteristic modes of coming to terms 
with the environment originate? It seems 
likely that many temperamental character- 
istics, particularly gross features such as rela- 
tive motility tendencies (in which large dif- 
ferences emerge in children [57]) may be 
constitutionally based. Certainly Freud (12) 
came to feel that quantitative factors in libido 
distribution were of such a nature. Neverthe- 
less, one is tempted to seek for considerable 
additional sources of individual variability in 
acquired characteristics, modes of adjustment, 
defensive techniques, or values learned from 
significant interpersonal situations in the 
family constellation. One may well ask, what 
sort of relationships in the family setting 
foster in the child a capacity to defer gratifi- 
cation or to temporarily restrain motor dis- 
charge in response to a need with subsequent 
resort to the realm of imagination or trial ac- 
tion? A clue is forthcoming in Freud’s stress 
on identification as a means of neutralizing 
libido and establishing ego defenses and coun- 
eaen ar amily constellations where 
washing napping, and za : oe tolkur 
een an sad — eation are the rule 

Uy, in order to master 
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their tensions, learn to accept delay since the 
sequence or pattern is consistent. In thus de- 
laying and striving to imitate the adults they 
find that resort to the level of fantasy gratifi- 
cation is possible and is frequently rewarded 
by parental figures or leads to new pos- 
sibilities for mastering the reality situation. 
Thought and delay become valued (ca- 
thected) and organized and a new hierarchi- 
cal structure of personality emerges, Lewin’s 
level of irreality (29). Within reasonable 
limits this pattern is highly adaptive and, 
indeed, one of the most uniquely human 
characteristics for it frees man from depend- 
ence upon immediate stimulation. Vet it can 
be carried to excess, as in the case where the 
extreme anxiety of parents leads to overly 
rigid patterns with the result that unceasing 
resort to inhibition and delay leads the child 
into obsessional rumination that gradually 
loses its reality orientation and creativity. 
Lair (26) has presented a review of con- 
siderable theoretical material and some data 
which support the view that an opportunity 
for identification with benign and loving 
adults in very early childhood is essential 
to the development of capacities for motor 
inhibition and planful fantasy. Goldfarb’s 
studies of adolescents whose first three years 
of life had been spent in institutions where 
close relationships with adult figures were 


not possible are highly suggestive in this con- 
hection. These instit 


almost uniformly a 
acterized by lack of 
activity, absence of « 
tern,” and lack of p 
per (25) has traced 
types of family conste] 


attempted identificatio 
reinforcing characteris 
figures. Mowrer’s for 


NY certainly 
‘pressing some of 
identification and 


on” in operational 
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terms and may open this area to experimental 
study. 

To some extent, it would appear, then, that 
the varieties and opportunities for parental 
identification may play a role in the capacity 
to develop delaying mechanisms and suitable 
imaginative processes. To the extent that so- 
cial class factors play a role in the organiza- 
tion of family constellations these factors may 
markedly influence the relative resort to de- 
ferred gratification patterns. The middle eee 
family with its routines, family unity at a 4 
times, and general emphasis on saving or ee 
cation ‘provides the child with a setting t A 
fosters such delay. This is particularly ag 
case since the consistency of the pattern i 
to the relative assurance that satisfaction wi 
come eventually. In the lower class farra 
parents are less available (particularly a 
thers), meals are haphazard with no are 
ance of their being forthcoming, and cb 
value of delay is less clear to the child. HA 
we may anticipate that lower class chil E 
will show different patterns of meani a 
cognizance, time evaluation, and imaginativ a 
ness. Some tendencies of this sort have ? na 
deed been reported in the recent literatu 
(27, 35, 46). ie 

Returning to the Rorschach movement ae 
sponse as a possible measure of delay nem at 
pacity and fantasy we might expect itive 
high-M subjects would show more posi ee 
feelings toward parents or at least wee 
identification with them. Studies with its 
TAT have offered some supporting gos 
but considerably more work remains tO ify 
done here (44, 50). It would be important t° 
study known family constellations and ial 
serve the patterns of delay, motor inhibiti 
or fantasy which emerge in the children. a 
Possibility might be exploration of a 
groups known to differ markedly in fam 
structures, e.g., Irish and Ttalian lower cla 

In conclusion, then, it seems plain ‘ace 
Freud’s original concept of delayed grat! aC 
tion leading to thought as experimental te 
tion is indeed a fruitful one. Tt is support 
in rough outline at least by the observatio 
of a host of investigators and by considerat 
experimental research particularly that w 
the Rorschach M response. The dimensio” 
motor inhibition—motion perception—fant@® 
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Seems a strikingly useful one, capable of em- 
Pirical study and providing an interesting ap- 
Proach to the study of personality structure 
in the family setting. The concept of delay or 
impulse control as a basic ego function af- 
fords also a highly significant contact point 
between psychoanalytic theory and general 
Psychology. More than fifty years after its 
original pronouncement, Freud’s theory of 
thought development is vigorously alive and 
eckons toward new vistas of research. 


Summary 


This paper represents an initial attempt to 
Place Freud’s concept of delayed gratification 
and thought development in the perspective 
of a broader framework of theory and re- 
Search in psychology. After tracing the de- 
velopment of this concept in psychoanalytic 
iterature, points of contact with early Ameri- 
can behaviorist and functional psychological 
Points of view were noted. Experimental re- 
Search that bore on the theory was cited with 
Particular emphasis on Werner’s sensory-tonic 
ii ty of perception and the empirical data 
of ‘ch has grown out of Rorschach’s linkage 
im Motor inhibition, motion perception, and 
S agination. Some implications of this con- 
i Pt for the study of identification processes, 
“ternal control mechanisms, and differential 
Parental influences in the family constellation 

Ste suggested. 
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Testing Behavior Hypotheses with the Rorschach: 
An Exploration in Validation 


Arthur E. Eschenbach 


a i Fi 
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and Edgar F. Borgatta 


Russell Sage Foundation 


Interest in the Rorschach as reflected in 
the literature, both in theoretical formulation 
and report of empirical findings, is extensive. 

ystematic empirical approaches, however, 
ave been few, and are primarily those in- 
Volving factor analysis of Rorschach scores 

» 11), or of these scores in conjunction with 
Other scores such as intelligence test perform- 
ance (10). The scoring categories or diag- 


poste signs which have been included in the 


i i en 
natrix of intercorrelation have not be 


identical, and where there has been replica- 


? Popular response, 


confused succession. What factors are 


t by the 


i in par 
* This research was supported in p BN gs 


é tN 
Mited States Air Force under contrac BES 
1°38)-12782 monitored by the Haman ae Ala- 
“search Institute, Maxwell Air tore ction, trans- 
Pan 2. Permission is granted for ae or in part 
ition, publication and disposal in 


al 
ernment. Person 
or for the United States Gover sre not to be 


aS conducted through the 
lations Harvard University. | tation submitted by 
Utilized derived from a disser llment of the re- 
the se Wes ior in partial fulf th University of 
Quire oe the Ph.D. degree at RI staff which 
Site ie ae grateful to ee ae. 
*Ssisted in various stages uns 


is determined in the limit of the approach by 
the items which are included in the matrix, 
and the subsections of a population which are 
yo a (12) has indicated the rele- 
vance of a validation study with discrete pes 
schach scoring variables, and Wittenborn an 
Holzberg (13) have presented the Pr e- 
mentary argument for using discrete de- 
scriptive or behavioral criteria of validation. 
Essentially, the point is that unless some com- 
mon variance is found between discrete scor- 
ing categories and discrete descriptive or be- 
havioral criteria, there can be little optimism 
for the diagnostic use of the scoring cate- 
gories involved. Wittenborn and Holzberg 
(13) found rather discouraging results in re- 
lating Rorschach scoring categories to symp- 
tom manifestations in descriptive diagnosis. 
Validation of a diagnostic tool should be in 
terms of the kinds of uses to which it is put. 
In this study we are interested only in certain 
aspects of scoring which are defined in terms 
of the responses of the subject rather than 
the general impression or evaluation of the 
interviewer. The use of the Rorschach as a 
medium of clinical interview is to be distin- 
guished from its use as a diagnostic tool in 
itself. That is, the Rorschach is a medium of 
clinical interview when it is used to establish 
rapport to observe the behavior of the subject 
or to evoke otherwise pertinent information 
which might be awkward to elicit in a formal 
interview. We are not interested in the char- 
acteristics which are most closely associated 
with the sensitivity and intuitive ability of the 
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interviewer, but with the scores which are 
most arbitrarily defined and reproducible. 


Procedure 


Studies which measure the difference of 
means of selected Rorschach scores among 
extreme subsections of the population may 
prove significant. The information may, how- 
ever, be of little value for prediction. That is, 
since two special cells are compared, or one 
special cell is compared to the remainder of 
the population, it may be that estimates of 
the amount of variance actually under con- 
trol will indicate that the relationship is too 
weak to be practically useful. In this study 
we are interested in measuring the relation- 
ship of Rorschach scores and behavioral de- 
scriptions which exist in a relatively broad 
population. 
a Subjects. Our sample consisted of 125 os- 
tensibly normal male Air Force enlisted per- 
sonnel representing the seven enlisted grades. 
The subjects were normally distributed on the 
SRA Test of Primary Mental Abilities, had 
an average age of 27 years with a range from 
20 to 45 years, and were also heterogeneous 
in regard to education and military occupa- 
tion. The only apparent nonnormal charac- 
teristic of this population was that a majority 
of the 18 Basic Airmen had recently been in- 
carcerated for breaches in discipline and had 
lost whatever military grade they had. 

Rorschach Scoring categories. Since the fre- 
quency in some of the commonly used Ror- 
schach scoring categories is extremely small, 
and the scores are discrete and unitary, these 
scoring categories cannot properly be utilized 
in testing relationships amo: 
is, the units of scorin 
too large for the 


y correlational require- 
ments. Split-half reliability of this t 


$ ype of 
item will almost invariab 


inv; ly be negative as a 
function of the distribution of the scores. For 
this reason, we have taken scores by the fre- 


quency of occurrence without regard to small- 
est detail specification, €g., we take C to 
mean the sum of all cases in which color oc- 
curs, such as C, CF, FC, FCV, etc. Our scor- 
ing categories in this study are: number of 
responses (R); F +/(F +) + (F — ; total 
color responses (C); total motion (M); total 


s G as 
The central six categories are known 
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vista (V); total shading plus texture Ce 
Y); total space (S); total large detail ( 4 
total rare detail (Dd); popular respon 
(P); organization (Z); content variety; ani 
mal plus animal detail (4 + Ad); anatomy 
An), total whole (W). f 
S os ac We a a the fifteen pet 
categories outlined above and have oe 
their relationship with five groups of varial ait 
selected as valid criteria: (a) scores of ra 
formance in interaction; (b) ratings by a 
periors; (c) primary mental ability aoe 
(d) sociometric status indices; and (e), ba 
round information. 4 
i The scores of performance in interact 
were taken in a “small group” expel 
which is reported elsewhere (4). The the 
represent the average number of acts A g 
person in four sessions which involve 8° E 
acquainted, planning role-playing sessioni ae 
free discussion. In each session, the Pethe 
participated with two different person g 
interaction observed in each session was arts 
period of 24 minutes, and represented Pa 
of the session in which the subjects BES ae 
sumably unaware of being observed. The ae 
gories of scoring used were those of in 
tion process analysis (1), which Dave a 
used extensively for behavioral descrip discus- 
group and individual performance in we i” 
sion and problem-solving groups. Here pasi 
clude the initiated behavior in the twelve e 
scoring categories, four subdivisions 0 
twelve categories, and the total. a 
Briefly, the categories of this obser a 
system may be identified as follows: nsio” 
gories 1, 2, and 3, showing solidarity, te nd 
release, and agreement; categories 4, tio 
6, giving suggestion, opinion, and orient opi” 
categories 7, 8, 9, asking for orientation, °F y, 
ion, and suggestion; and categories 1 ' and 
and 12, showing disagreement, tensions ree 
antagonism. The first three and aa nego 
categories are known as the positive an 


Foe ite : tively" 
tive social emotional categories, respec™ ihe 


tiot 


task categories. py thé 
The ratings by superiors were made havi” 
highest ranking commissioned officers } rme®: 
direct or effective contact with the a ce 
The ratings were in terms of perform” ne 
variables judged particularly important 1? 


_ — 
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military context: ability to understand the 
situation and take necessary initiative; ability 
to handle men and make himself understood 
by his men; knowledge of the technical as- 
pects of his job; personal conduct and bear- 
ing; and general over-all rating. 

The scores of primary abilities included are 
those from the SRA Primary Mental Abili- 
ties: verbal meaning, space, reasoning, num- 

er, word fluency, and a total quotient. 

The affective sociometric indices are: pro- 
ped to be a chooser, propensity to expect 

e chosen, choices received (popularity), 
®Xpectancy of others that one will be a 
Chooser, These were based on a criterion of 
enjoyment of participation in the session com- 
Potea, Two other indices on a criterion of 
see done to determine the way the ses- 
leade Went are also included: chosen as a 

t, and chooses self as a leader. 
edi; © background information includes age, 
ol level, and the subject’s military 


Method of Analysis 


The method of analysis was governed by 
sas rience in the search of empirical hypothe- 
P Concerning Rorschach variables.* The first 
iestion concerned the relationship of R, the 
mber of responses, to the criteria. The sec- 
the question concerned the relationship of 
H Other Rorschach variables to the criteria. 
in eet since we were primarily interested 
att 2€ relationships of the other variables not 
‘ibutable to the number of responses, our 
es Was one of partial correlations (Table 
ire, e Were further interested in whether the 
e relations tend to be ordered properly in 
8ard to behavioral hypotheses which are 
posed according to the criteria included. 
lo on if the degree of relationship involved is 
Sues proper ordering of relationships ac- 
cag S, to hypotheses would indicate the 
ti Sibility of a multiple regression (configura- 
onal) approach. Thus we stated forty-four 
YPotheses. The hypotheses were then tested 


ex] 


Co 


2 

or neralizations of relationship of Rorschach 
are Categories to personality characteristics have 
listeg compiled from the five sources (2, 3, 7, 8, 9) 
een ue the references, These generalizations have 
tak, Published separately (5). The generalizations 
M en for hypothesis test here are those considered 
Ost clearly stated in relatively systematic texts. 
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on the basis of the expected coefficient signs 
of the relationships of the Rorschach scoring 
categories with the multiple criteria. 

Our definitions of variables for the tests of 
hypotheses were established before examina- 
tion of the data.” We do not have space for 
justification of the behavioral criteria, which 
do not have obvious face validity in all cases. 


Testing the Hypotheses 


In the tests of hypotheses, for economy in 
presentation, we provide the information in 
Table 2 in the following order: (a) The hy- 
pothesis is stated. (b) At least one source of 
the statement is indicated. (c) The identifi- 
cation of the variable(s) in Table 1 to which 
the Rorschach variable is to be compared is 
stated. (d) The expected sign of correlation ~ 
under hypothesis is indicated. (e) The actual. 
sign of the correlation in Table 1 is given, 
(f) Hypotheses are judged as: rejected (sig- 
nificantly in the wrong direction); in the 
wrong direction; in the right direction; not 
rejected (significantly in the right direction). 
Where two or more possible tests are avail- 
able, they are given consecutively. For the 
two-tailed test with .05 level, absolute r = 
174 is significant (italicized in Table 1), 
which is equivalent to the .025 in hypothesis 
testing. 

Summary and Interpretation 


Of five hypotheses examined concerning the 
meaning of the total number of Rorschach 
responses, one was definitely not rejected and 
the other four were ordered in the right di- 
rection. 

Of thirty-nine hypotheses other than those 
concerning the total number of Rorschach re- 
sponses, with forty-four possible tests, there 
were: two nonrejection, twenty-one ordered 
in the right direction, twenty ordered in the 
wrong direction, and one rejection. 

If hypotheses concerning intelligence only 
are considered, there are (including total R): 
three nonrejections, four in the right direc- 
tion, and two in the wrong direction. 

While it is interesting to consider statements 
concerning the need for “configurational” in- 

8 We are extremely grateful to Robert F, Bales for 


his help in choosing the interaction behavioral cri- 
teria. 
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Table 2 
Sign Test of Hypotheses 
Expected Actual 
Hypothesis Source Criteria signs signs Judgment 
1. High R is associated with high 2; s. r A f; g; h; i; + + not rejected 
intelligence p. 208 j;k RN an a 
2. High Ris associated with compul- 3, p. 72 gg, ee ++ ++ in right direction 
3 Siveness, drive for thoroughness Sot aa 
+ Subjects in good humor tend to 9, p. 21 v T T in right direction 
have a high R E ee 
4. Sullen and unobliging subjects 9, p. 21 dd, ee ++ ++ in right direction 
š tend to have low R ENTO «. 
i High R is associated with manic 9, p. 21 hh, gg ++ ++ in right direction 
conditions (depression hypothe- 
S 1S conceived as identical here) t Pa Rete 
g High W is associated with high 3, p. 20;2, f; 83 h; i; + + in right direction 
7 Intelligence p. 10 i;k we: E A 
< High W is associated with self- 9, p. 59 gg E T in right direction 
assertiveness m F + in right direction 
8. igh W is associated with com- 7, p. 245 ee, gg ++ -f in wrong direction 
9. bulsiveness thi a le 
* High W is associated with manic 2, p. 13;9, hh, gg TE ++ in right direction 
conditions p. 40; 8, 
10. Low Wisassociateawithansiety 3 oa = dies e —— in right direction 
5 ssociated with anxie - a mie 
11. High y is associated with “over- 2 p. 14,58, xy ++ in nent direction 
all thinking” (abstract ideas and P- 57 h F N HESSD, 
Major issues ats on Fs E 
mm igh D is Ceased with com- 8, p. 5837, ab FF -= edeo 
mon sense or practicality P- ms 32, 
p- = aen 
13. High p is associated with de- 2, p. 15 hh, gg a a in right direction 
14, eon + g; h; i; = = not rejected 
F int Da is associated with low 3, p. 28 ‘ ik mane 
eligenc E ss PEA ae 
S5. igh Da i associated with com- 2, p. 14 ee, 88 tt + in wrong idirection 
Dulsiven, i it 
E igh Da $ associated with nag- 3, p. 28 ff, x EF = a EONS: direction 
17, 8g and fault finding F 2 = (ote 
ee lig Dd is associated with low 3, p- 27 a, b = => in right direction 
aptabili r eee 
‘8; High 5 a with oppo- 2, p.47;7, dd ff ae +— in wrong direction 
Sitional behavior p. 266; 8, 
P- aik . prea 
= Low $ is associated with pas- 2, p- 47 w, ee PF in wrong direction 
sivit, : 
20. To ; f; g; b; i; + + t reject 
Total Z varies directly with in- 2,p- 12 ; Ek i not rejected 
21, pigence 2, p. 13 vo i = in wrong direction 
` Migh Z is associated with elation P = a recti 
= igh F- percentage is associ- 9, p. 56 i i in wrong direction 
a with attention to task and 
lity to trati eae ee š N 
3 igh F 5 Apel e is associ- 2, p. 19 hh, gg gi in right direction 
ated with depressi na 
24, ow F+ percentage is associ- 2, p. 19 v = = in right direction 
ated with elation sap hei ERE 
E High F+ percentage is associ- 2, p- 19;3, $ g: Bs 3 + it in right direction 
ated with intelligence p- 35, 37 l; 
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Table 2—Continued 


Expected Actual 


Hypothesis Source Criteria signs signs Judgment 
26. High M is associated with high 9, p. 26; 7, f; g; h; i; in ri irection 
intelligence a 268; 2 i Pe um ij j ici 
p. 23 | 
27. Low M i i zi z à recti 
cca E is associated with de- 9, p. 27 hh, gg ++ +- in wrong direction 
28. High M is associated with elation 9, p. 27 in right directi 
1 o nee mt P- v + + in right direction 
29. High color is associated with allo- 2 31 in ri irection 
centricity and awareness of en- J ene +++ it 1. 
vironment 
30. me m is associated with ex- 9, p. 98 ee, ff p e in wrong direction J 
31. High color is associated with 2. in ri irecti 
energy and initiative (with which pe = T c bee right date 
T subject attacks problems) i 7 Si 5 PEA E i l 
Bich: colr i : n in ri ar s 
high effectivity E AN 9, p- 76 hh, kk ++ pa in SA directio? 
33. Low color is associat d wi = 5 irecti 
pression gigi ap S : A hh, gg FF —+ in wrong direction 
ols. 3, 
34. High shading is associated wi Be 
sie 4s associated with 2,p. 35,36 hh, gg an ++ rejected 
35. High shading is associ ji 5 i 
‘ TERN g sociated with 2, p. 35 w, ee 44. hs in wrong directio” 
6. High ing i; i : F 
i ES os Js associated with 3, p. 51 v, ee one des in wrong directio? 
37. High vista is associa i 
ted wi 7 irecti 
feeling of inferiority meetin 2, p. 33; 9, ee + + in right directio? 
38. High vista is associated with de- 2 p DR irectio? 
ON my oie 9, bh, gg -- ++ in wrong direc 
. Animal form is invi J; s irecti 
go, YÈ intelligence Se. Bed fieshsi; — +? in wrong directi?" 
. High animal response i j; 4 
ee eh childhood 8p. 80 r - — in right directio” 
+ Hgh anatomy respon: a irecti 
Sociated with hypochondriasis 2, p. 43; 3, ee + — im wrong directio? 
42. ae variety, of content is related 7 i a f A directio? 
igh intelli i EE aad 385 h; i; = i ai 
oe dhede =f RaT + P P put word fuen 
43. High variety of ; igni t) 
to high Sea ezed 7, p. 272; s A signifier ection 
44. Low number of popular en 2,p.41, 4 + + in rig! 
. a A ses . irecti' 
1S associated with low intelligence 2, p. 17 f; gi hs i; ae $ in right directio” 
J; 


+ ctr” 
proached more efficiently by other inst” 
ments. 

. . s, T 
The implications of findings of this o 


. D a 
; are twofold: (a) Whil ight quest H 
ordering of relationships BIS ground. The the validity a ie criteria, tthe questiones j 
needs to provide better criteria to demonstre 
the relationships exist in fact. Pointing t° e- 
significant differences found in carefully Pine 
classified groups is not a demonstration 0f ` pe 
validity of the measure. It does not constitt 
forward selection or prediction. Equally * | 
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Portant for consideration is that the preselec- 
tion criteria may be easier to apply than the 
test; extreme behavior may be recognized by 
Other tools (including even direct questions). 
(5) The matrix of intercorrelations indicates 
that, although the amount of variance under 
Control in any given instance is small, for lim- 
ited purposes a forward validation study of 
the Rorschach may indicate utility of some of 
the arbitrary scoring categories in use. 


Received September 8, 1954. 
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Predicting Success on the Member-Employee 
Rehabilitation Program’ 


Bernard A. Stotsky 


VA Hospital, Brockton, Massachusetts 


To aid in rehabilitating chronic hospital- 
ized psychotics, the Member-Employee pro- 
gram was instituted in VA-NP hospitals. Se- 
lected patients were discharged and placed in 
full-time salaried positions as employees of 
the hospital. Employment in a normal work 
atmosphere was designed to help them make 
the transition from hospital to community 
more easily. Selection of member-employees 
by the Medical Rehabilitation Board was 
mainly on an intuitive basis, 

This study was undertaken to discover ob- 
jective criteria which could be used to pre- 
dict success on the program. The Guilford- 
Zimmerman, Manson, Revised Beta, Purdue 
Pegboard tests, patient attitude, Palo Alto 
Hospital Adjustment, Northport tating scales, 


1 An extended report of this study may be ob- 
tained without charge from Bernard A, Stotsky, 
e Brockton, Ma: 


+ a] items 
and information on seven biographical itey 
were collected for the first 18 ee 
Proved by the board. Of all the tests, raphi 
and items used, only three of the bink ote 
cal items—arrests for any except psy e 
reasons, dificulty with alcohol eet jes wi 
past two years, and present difficu from the 
alcohol—differentiated the one the 
unsuccessful member-employees. V for 
sample increased to 36, differences el, TH 
three items were significant at .05 e class” 
item, present difficulties with pecan. y 
fied 35 out of 36 correctly, being P ais ite” 
related to failure (p < .001). OnI a poatd 
Predicted significantly better than 2 froh 
(p = .02). For a second sample = not 9 
another VA hospital, the item did 7 end 
criminate better than chance though 

was positive (p = .11). 

Two main reasons for failure ae z 
gram were exacerbation of pon Fron 
toms and overindulgence in aloro rA 
these findings it appears that alco ae 00 
incompletely stabilized psychotics 
Prospects for a program of this tyP® 
Brief Report 
Received March 9, 1955. 
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Relations Among Several Objective Measures of 
Anxiety Under Different Conditions of Motivation’ 


Anthony Davids 


Harvard University 


sae Chologists have long agreed that the 
Tetic es of human anxiety is of great theo- 

o he and practical significance, but it seems 
sim; ie taken the development of a rather 

cs oo questionnaire to open the floodgates 
ings © case a tidal wave of experimental find- 
nee ae will not even attempt to review the 
the of publications that have appeared on 
repor c Pological scene since Taylor recently 
aries on her scale for measuring manifest 
has ‘tel (18, 19). Performance on this scale 
Mental o related to a wide variety of experi- 

~ "Yeliq Measures, including such things as 
camin o ditioning (9, 16, 17, 18), verbal 
reaction. (11, 15, 20), word associations (3), 
lective s to stress (4, 22), responses to pro- 
Plex tests (8, 22), and various other com- 
hensive @viors (1, 7, 14, 21). Also, a compre- 
any © review of these studies and a great 
Tather Others has been prepared (13). So, 
famili than discuss studies that are probably 
literatu, to anyone acquainted with the recent 
side, “@ we will turn immediately to con- 


1 
lop: Thi 
ata Chey conducted at the Harvard Psycho- 
fan the direct), Patt of a program of research un- 
Yp tateq ection of Professor Henry A. Murray, was 
ate Tese; by the Laboratory of Social Relations. 
at ee Project was supported in part by a 
~709 fe the Rockefeller Foundation, and by grant 
k blie Taa the National Institute of Mental Health, 
wO Wed ealth Service. The author gratefully ac- 
ho Bes the assistance of Mr. Leo McNamara, 


“ he] 
0 i A s 
‘ the dees with the scoring and statistical analysis 


anxiety scale; (b) Psycho-somatic Inventory; 
and (c) anxiety self-ratings. 

More specifically, there were two main pur- 
poses in this study. First, we wished to ex- 
amine the intercorrelations between results on 
the different measures within each of two 
groups of subjects. Second, we wished to see 
what effect the experimental manipulation of 
motivation would have on responses to the 
various objective measures of anxiety. 


Method 


Subjects. There were two experimental 
groups, each consisting of 20 male under- 
graduates selected from an introductory psy- 
chology course. With the exception of the 
experimental manipulation of motivation, de- 
scribed below, the procedure for selecting 
members of both groups was designed to con- 
trol as many relevant variables as possible. 
The groups were matched to the extent where 
we felt quite certain that any differences re- 
vealed on the experimental measures could 
probably be attributed to the different condi- 
tions of motivation under which they were 
examined. 

Treatments. The first group of 20 Ss com- 
pleted the questionnaire and self-ratings in 
the course of their service as paid volunteers 
participating in an intensive investigation of 
personality. They believed that the results 
were anonymous, and were informed that the 
data would be used solely for purposes of 
“scientific research” and would not affect 
them personally in any way. The second 
group of 20 Ss was comparable to the first, 
with the exception that they were informed 
the results would be used to select one or 
two members from the group to work as 
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highly paid assistants to staff members con- 
ducting research on small group interaction. 
They were led to believe that we were look- 
ing for mature, well-adjusted individuals who 
would be able to observe and analyze the be- 
havior of others with minimal interference 
from their own problems and abnormalities. 
At the time of selection, an interview was con- 
ducted with each S in order to ensure that 
only individuals with high motivation to se- 
cure the position would be used in the pres- 
ent study. . 

Measures. The Taylor scale (19) consists 
of 50 items selected from the Minnesota 
Multiphasic Personality Inventory (MMPI) 
on the basis of clinical judgment that the 
items are indicative of manifest anxiety. These 
statements, to which S answers either “true” 
or “false,” are embedded in a Biographical 
Inventory which contains 175 additional 
buffer items that were also taken from the 
MMPI. The maximum possible anxiety score 
is 50 and the minimum is zero. 

The Psycho-somatic Inventory (12) con- 
sists of 92 questions, of which 46 refer to 
psychological experiences and 46 refer to 
physiological experiences. These experiences 
are supposed to differentiate the “psychoneu- 
Totic” from the “normal” individual. The 
questions are answered on a 4-point scale 
Tunning from “often” to “never,” and the 


total score based on the entire inventory 
Provides a measure of “ 


The anxiety self- 


rating scale (2 consist 
of five parts. There o ar 


are four subratings in re- 


Table 1 


Rank-Order Correlations Among Three Measures 
of Anxiety Under Two Conditions 
of Motivation * 


Taylor Psycho- i 
Measure anxiety scale ‘ive 4 
Anxiety self-ratings 60** 74 
Taylor anxiety scale ee rs 


* Italicized coefficients are for the 20 “re ” 
ang. monaticized coefficients are for the 29 s4f°n Volunteers 


A coefficient of .52 is Significant at J 
tailed test. at the .O1 level for a one- 


Anthony Davids 


sponse to specifically defined experiences a 
feelings indicative of anxiety, and one ee 
rating. The four subratings are concer ad 
with (a) illness, (b) irrational fears, (c) a 
security, and (d) anxiety symptoms. Fore es 
subarea several examples are provided in of 
der to leave little doubt as to the me 
thoughts and behaviors being assessed. a 
general rating follows the four sübratmg™ 
the instructions read: “Comparing you ate 
with others of the same sex and me i 
your usual level of general anxiety by M FE 
a cross on the appropriate point on a EN 
lowing scale.” Each of the five sepata aian m 
ings is made on a 6-point scale, running more 
“much less than most people,” to “much da 
than most people.” Summing scores Ms a 
five ratings, the maximum anxiety scor, 
tainable is 30 and the minimum is 5. Lit 
Predictions. Our expectation was Da e 
would be a significant positive associati f 
tween the different measures of anxiety 5 ans 
each group, and that there would be on 
iety evidenced by the ‘job seekers 
the “helpers of science.” 


ere 


Results and Discussion 


The results presented in Table 1 E inte” 
within both groups there are significan meas 
correlations among the three differen orr 
ures of anxiety. In both groups, the ¢ e nd 
tion between the manifest anxiety o u 
the Psycho-somatic Inventory is not P ff 


w that 


ee coe! 
lower in magnitude than reliability F ale 
cients reported for the manifest anxiety ” Jor 


(19). These results indicate that th of ar 
scale is not unique. Regardless of s D 
ticular instrument employed to ae uit? 
iety, the relative standing of the 55 Í 
similar. for the 
Comparing the mean anxiety or that 8 
two groups, it is evident from Table ple pie 
who are motivated to present a favora? ye 
ture of themselves reveal less anxiety m 
sponse to each of the three assessme i patin” 
ods. Rather unexpectedly, it is the s€ 
scales that show the least difference Psyc 
the two groups. In response to the up with 
somatic Inventory, members of the ar on 
nothing to gain by deceiving us reve gdm 
selves as more neurotic. That is, wo ps 
having more experience with disturbing 


eS << O 
EE Ee, 
ee ee ________™ 


Relations Among Measures of Anxiety 


Table 2 
N Comparison of Anxiety Scores for Two Groups of 20 Ss 
“Research volunteers” “Job seekers” 
x Measure Mean Variance Mean Variance F t 

DXi z 

yeka elt ratings 15.6 36.1 15.0 36.7 1.00 29 
" Dia matic Inventory 137.7  25730.9 202.2  10902.4 2.36* 1.50 

nxiety scale 20.8 64.3 13.8 46.6 1.38 2.96*¥ 


' 


* Signi 
ae g SNificant at the 0. vt 
ignificant at the Ot lovey 


~ iet 
Late scores indicate greater disturb- 
aPpear i ae the Ss who are motivated to 
tween the ell adjusted.” The difference be- 
level of se means does not attain the .05 
Veals at canes; but Bartlett’s test re- 
teer regear h. variance for the group of volun- 
is what ai Ss is significantly greater, which 
ot moti e would expect in a group that is 
the dire Wated to distort their responses in 
T of social acceptability. 
Corq „8 the above differences are in ac- 
Our theoretical predictions, it is 
ey Manifest anxiety scale that shows a 
~ Means ;» Significant difference between the 
Seva, ct the two groups. This difference of 
Show; Mts, with the highly motivated Ss 
beyon 8 “se Manifest anxiety, is significant 
Present < 01 level, indicating that, in the 
SSceptibig. a the Taylor scale is especially 
area 
fhe aa to present a favorable picture of 
ne tmath, - This finding receives additional 
he Brou ton from the fact that seven Ss in 
“Dxiety P of “job seekers” received manifest 
of 1g cores that were lower than the score 


„s Stoup schieved by the lowest-ranking S in the 
At a: 
; t 
high A his 


of “research volunteers.” 

re degr, Point, let us consider briefly the 
Veq fro ĉe of consistency among findings de- 
` feat different measures of anxiety. T. his 
“Stigat ated finding for several previous in- 
tiong Ors have also found significant rela- 
‘ale p tween anxiety measured by the Taylor 
tive es anxiety measured by other objec- 
ter r Tuments, Holtzman, Calvin, and Bit- 
wit he (10) correlated Taylor anxiety scores 
(23) sa ucism measured by the Winne scale 

= Correlata found a coefficient of .74. When the 
to the 02 Was corrected for attenuation due 
Unreliability of each scale, it increased 


to Ss’ conscious or unconscious ` 


to .86. These scales represent independent 
adaptations from the MMPI, and contain 7 
overlapping items, but, nevertheless, the mag- 
nitude of this relationship is quite high. In 
another study, Deese, Lazarus, and Keenan 
(4) found a correlation of .69 between the 
Taylor scale and Winne scale. 

The psychasthenia scale from the MMPI 
has also been found to relate positively to the 
Taylor scale. Deese, Lazarus, and Keenan 
(4) obtained a correlation of .81 between 
these scales, and a correlation of .40 after 
overlapping items had been eliminated. Erik- 
sen (5) reported a correlation of .72 between 
these same scales. And Eriksen and Davids 
(6) secured a correlation of .92 between psy- 
chasthenia and manifest anxiety. This latter 
finding was reduced only slightly, to .86, 
when 8 overlapping items were excluded. 

These results, coupled with findings in the 
present study, indicate that performance on 
the Taylor scale of manifest anxiety is highly 
related to (a) self-ratings on anxiety; (b) 
neuroticism on the Psycho-somatic Inventory; 
(c) neuroticism on the Winne scale; and (d) 
psychasthenia on the MMPI. In many in- 
stances, the magnitude of relationship be- 
tween the independent scales is about as high 
as reliability coefficients for the Taylor scale. 
Thus, several seemingly diverse researches 
seem likely to be investigating very similar, 
if not identical, phenomena. It may be, as 
Eriksen and Davids suggest (6), that the 
Taylor scale is not so much a measure of 
amount of anxiety as it is a measure of the 
way people respond to or cope with their 
anxiety. At any rate, these consistent findings 
from independent investigations, relating re- 
sults on the different objective ineasures to 
performance in a variety of psychological ex- 
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periments, suggest that these several lines of 
research should be brought together and 
viewed in some common framework. 

In conclusion, we would like to point out 
that the Taylor scale is only one of many 
available objective techniques for assessing 
anxiety. And it may well be that other in- 
struments, some of which have been estab- 
lished for years, provide even more valid 
measures of anxiety than does the Taylor 
scale. Evaluated according to the criterion of 
generating research, there is no doubt that 
this scale has made a notable contribution. 
Yet the reason why psychologists have seized 
upon this instrument with such eagerness is 
not easy to understand. In fact, one could 
ask, legitimately, “Why the emphasis on the 
Taylor scale?” An attempt to answer this 
question is beyond the scope of this paper. 
Here, we wish merely to stress the point that 
any one of several objective instruments could 
probably be employed with equal fruitful- 
ness in the selection and classification of Ss 
for investigations of anxiety and behavior. 

One thing, at least, seems certain, When ob- 
jective measures are employed, and responses 
accepted at face value, the condition under 
which the Ss are examined is of considerable 
importance. When the examinees have some- 
thing to gain by reporting fewer experiences 
with disturbing anxiety, these objective meas- 
ures are quite susceptible to distortion. Re- 
sults of the present experiment suggest that 
the Taylor scale may be even more susceptible 


to deception than are other objective meth- 
ods for assessing anxiety, 


Summary 
Two groups of male 
administered the Taylo: 
cho-somatic Inventory, 
ing scale. One group 
procedures as voluntee: 
research project, with a: 
The second group of 20 Ss was informed that 
the results of the test battery would be em- 
ployed to select a few “mature, well-adjusted” 
individuals to work as Paid assistants con- 
ducting psychological experiments, 
In both groups highly Significant intercor- 
relations were found among the three objec- 


undergraduates were 
r anxiety scale, Psy- 
and anxiety self-rat- 
of 20 Ss took these 
rs participating in a 
nonymity guaranteed. 


Anthony Davids 


tive measures of anxiety. When the ae 
were compared, it was found that i 
three measures the group of “research voiu 
teers” achieved scores more indicative i 
manifest anxiety and maladjustment oe 
the group of “job seekers.” Although ati 
results were all in keeping with our aie if 
cal expectations, it was only on the sca aa 
manifest anxiety that the difference vena 
the two groups attained the .01 level 0 
tistical significance. 5 

It was eonauad that (a) the Taylor be 
iety scale measures essentially the aaa 
able or trait as that measured by severa H 
available instruments, (b) the Taylor a™ tion 
scale may be more susceptible to doceni : 
than are some of these other instruments, r 
(c) a number of seemingly heterogeneo 
searches may actually bear upon © 
phenomena. 
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A Further Investigation of the Relationship Between 
Manifest Anxiety and Intelligence 


Allen D. Calvin, Paul B. Koons, Jr., Joseph L. Bingham, 
and Howard H. Fink 


Michigan State University 


Grice (2), who worked with airman basic 
trainees, recently reported a significant nega- 
tive relationship between Air Force Clerical 
Aptitude Index scores (which he states may 
be regarded as a general intellectual meas- 
ure) and performance on the Taylor Mani- 
fest Anxiety Scale 


who also worked with Air Force trainees, re- 


with a number of Air Force tests of intel- 
lectual abilities, Matarazzo et al. (4) used 
college students as Ss and failed to find a sig- 
nificant relationship - between A-scale scores 


to the 4-scale literature, 
have, in fact, been unable, over a Period of 
years, to find any relation between A-scale 
Scores of college Students and conventional 
measures of intellectual ability, such as en- 
trance-examination Scores and grade-point ay- 
erages” (1, p. 10). 
Because of the w 
scale as a research 


State: “The authors 


vestigates some of the 
equivocal results obtain 


Method 
Subjects. The Ss were ol 
Separate sources. The firs 


> 


btained from two 
t group, hereafter 


referred to as Group A, were students in fy 
undergraduate course in psychology at e o! 
gan State University. The group consisted © 
36 Ss, 21 males and 15 females. d to 38 
The other group, hereafter referre! -study 
Group B, was obtained from a howto aa 
course offered for students who WEL ss fot 
scholastic diffculty. Two additional in dle- 
this &roup were selected from a ae ex” 
mentary psychology in which they n e 
periencing considerable difficulty m of 151 
course material. This group had an 
12 males and 3 females. In 
Procedure. The Wechsler-Bellevue divi 
gence Test (7) was administered in in ae 
sessions to each S. The A scale was Las, s sug’ 
with the Biographical Inventory items 
gested by Taylor (6). 


telli- 


Results anged 

The Wechsler scores for Group z E an 

from 102 to 141 with a mean of 1 sual f0" 
a o of 9.18. This range, while not unu 

college students, is lacking in low 


j itiona 
therefore we decided to obtain additio paii 


s 
of lower intelligence, and Group B wa 


3 a 
tained (range 92 to 129, mean 1 
10.41). However in order to obtain select 
such low scores it was necessary t gemi? 
students having trouble with their ac a 
work—this being an almost invariab pop 
Comitant of such scores in a university $ jor 
lation. This, of course, creates some 4 ores © 
as to the propriety of combining the ae pre 
Group B with Group A. We decided 1s0 t° 
sent the data for Group A alone and 4 com” 
Present the findings for the two group. a tbe 
bined. In interpreting the findings fo 
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| 


4 


Manifest Anxiety and Intelligence 


. 


Table 1 


Pearson 7’s between A-Scale Scores and 
Wechsler Performance 


Combined - 
groups 
Item Group A A and B 
Full 1Q 2 ir 
=e =31 
Verbal 19 —22 39% 
Performance IQ —.15 —18 
nformation —.11 = 
omprehension —= 19 — 25 
igit Span —.37* —.31* 
Arithmetic —.19 —.31* 
Similarities —.02 SA 
ecabulary 08 —.29" 
TR Arrangement —.02 13 
Noel ap ompletion —.07 —19 
Obi Desi —.36* — 48" 
bject Assembly =83 —.29* 
igit Symbol 02 =H 
“Sitnitcant STA eve: bs 
Combin, ñ 
e 
lig gy 03 groups (range 92 to 141, mean 


bear „? 7 11-56), the reader should, of course, 
Was at mind the manner in which Group B 
elected, ; 
© results for Group A alone and for the 
ined groups appear in Table 1. The cor-, 
pus (presented are between A scores 
S e derived IQ scores (prorating for’ vo- 
aay where AE and between A- 
ing cores and raw subtest scores. Examin- 
€ findings for Group A first we see that 
°rrelation between total IQ and mani- 
a ‘nxiety is not significant; however, an 
Veale nation of the subtest correlations. re- 
`S 5 Significant negative correlations between 
Ga: Scores and Digit Span and A-scale 
+S and Block Design.2 h 
indic © results for Groups A and B combined 
e ate a significant negative relationship n 
To 2 4-scale scores and Full Scale IQ, Verbal 
cal pa ormation, Digit Span, Arithmetic, Vo- 
bly. aty, Block Design, and Object aa 
€cause of the previously mentione 


Comi 
relati 
and 


ec 


1 ; 
bee is interesting to note that these subtests jis 
800g Mentioned by numerous clinicians as being 
differ anxiety indicators, and some investigators m 
Subteste Measures of anxiety have also found thes 
eni Sts able to differentiate anxious Ss. The experi- 
S] A findings are far from unequivocal; however, 


het Precludes an adequate discussion of this topic 


J 
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scholastic difficulties of Group B which is 


» confounded with their lower IQ scores, it is 


impossible to make any unequivocal inter- 
pretation of these results.? However, these 
findings indicate the necessity of restricting 
the conclusions drawn from a particular ex- 
periment to the population under study and 
the specific measure of intelligence used. 


Discussion 


Although we failed to obtain a significant 
negative relationship between A-scale scores 
and IQ in our “normal” group of students, 
which supports the previous findings of Schulz 
and Calvin (5) and Farber and Spence (1), 
our finding in the “normal” group of a sig- 
nificant negative correlation between A-scale 
scores and several Wechsler subtests, plus the 


highly significant results obtained when the 


students with lower IQ scores (and concomi- 
tant scholastic difficulties) were added, indi- 
cate the necessity for closely examining the 
intellectual make-up of the individuals used 
as Ss in any experiment utilizing the A scale. 
It seers quite possible, as Kerrick (3) sug- 
gests, that the contradictory findings reported 
by various investigators who used the A scale 
to select high and low anxious groups for 
learning experiments, conditioning experi- 
ments, etc. were due to variations in the in- 
tellectual make-up of the respective experi- 


mental populations. 
Summary 


Two groups of college students were given 
the Wechsler-Bellevue Intelligence Test and 
the Taylor Anxiety Scale. Group A was com- 
posed of 36 students in an undergraduate 
psychology class. Group B was made up of 
15 students with lower IQ scores who were 
having academic difficulty. 

Significant negative correlations between A-. 


2 Confounding of another type also exists in the 
relationship between anxiety and intelligence, As 
Grice (2) and Kerrick (3) pointed out, it may be 
that the highly anxious S is handicapped on an in- 
telligence test and therefore obtains a lower acre, © 
than his “true” score. 

Our colleague Dr. Charles Hanley suggests another 
possibility. He feels that the Ss of lower intelligence 
may have difficulty understanding the A-scale items 
and may inadvertently check items which raise their 
A-scale scores. F 
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scale scores and several Wechsler subtests 


were reported for Group A, and when Group + 


B was combined with Group A the 4-scale 
scores of the combined groups showed a sig- 
nificant negative correlation with Total IQ, 
Verbal IQ and a large number of subtests. 
The implications of these results for con- 
temporary research in this area are discussed. 
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The Correlation of Intelligence and Neurological 
Findings on Twenty-Two Patients 
Autopsied for Brain Damage’ 


Robert S. Morrow 
VA Hospital, Bronx, New York 


and Joseph C. Mark ° 
VA Hospital, East Orange, New Jersey 


Thi ; 
tensive wong the first part of a more ex- 
types of Si, ae of the effects of various 
Psychologic ea brain pathology on the 
ult male: al test performance of twenty-two 
Patholog s. In each of these cases the brain 
termined by the main cause of death as de- 
tients had vee All of these former pa- 
chological received a routine battery of psy- 
Sual n diagnostic tests as well as the 
niques urological examination and tech- 
e Mg EEG, laboratory studies, etc. 
the Psych of the investigation is to correlate 
Bical a ological test results with the neuro- 
nd post-mortem findings. 
eon paper deals solely with th 
Structural brain pathology on ! 


h the ef- 


Hi tel 
ntel- 


1 
A F 
tierie pen version of this paper was read at the 
hen, aoa e logical Association, New York, Sep- 
» 1954, 
europaea with the Clinical Psychology Section, 
tration ruat Service of the Veterans Adminis- 
as do ospital, Bronx, New York where this work 
debtedne: The authors wish to express their in- 
Sistan, ess to the following: Dr. Louis Berlin, As- 
Medical tofessor of Neurology at Cornell University 
Hospital College and former chief of the Bron¥ V; 
Oblem, Neurology Service, for his assistance 07 the 
neropatti involving neurology, neuroanatomy, and 
Hospital hology; and to the following Bronx VA 
Chief Gin members: Dr. Jacob Cohen, Assistant 
tistical linical Psychologist, for his 
Neuro, ey aluations; to Dr. H. L. Fl 
Neurge > chiatry, and Dr. E. G. Kreuger, Chief of 
ti a for their cooperation and support, and 
Ry wh arold G. Wolff, senior consultant in neurol- 
this qs’ Searching questions and comments inspired 
udy, 


2 


help on the sta- 
lowers, Chief of 


lectual functioning as measured by the Wech- 
sler-Bellevue Intelligence Scale and specifi- 
cally it will report on: 

1. The relationship between structural brain 
pathology and total as well as subtest Wech- 
sler-Bellevue scale functioning. That is, the 
Wechsler-Bellevue results of this obviously 
brain-damaged group will be analyzed and 
compared with a control group. 

2. Comparing the test scores of those whose 
locus of damage is in the anterior region of 
the brain (pre-Rolandic) with those whose 
lesions are in the posterior regions (post- 
Rolandic). 

3. Comparison between the effects of focal 
and diffuse brain pathology on the intelli- 
gence test. 

4. Comparing the effect of dominant cere- 
bral hemisphere lesions with nondominant 


ones. 
Historical Background of the Problem 


The literature on the relationship between 
brain disturbance and psychological function- 
ing is extensive, even when confined to studies 
of patients rather than animals. Klebanoff 
(17, 18) has written two excellent surve 
The recent use of intelligence tests such = 
the Wechsler-Bellevue Intelligence Scal o 
the studies of brain functioning has yi Jd ad 
valuable information regarding some = a 
older theories of brain functioning. r i 
localization theories, and has raised be A 
important hypotheses. For the ads pant, 

? 
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however, the studies using the Wechsler-Belle- 
vue test were concerned with the development 
of test patterns as diagnostic Signs as indi- 
cated in the writings of Wechsler (27) and 
Rapaport (21). Allen’s (2, 3, 4) studies are. 
typical of this approach. 

The major criticism of these studies has 
been their failure to use adequate control 
groups to permit the comparison of patho- 
logical brain function with the function of 
Persons free from structural brain pathology. 
Many studies have been reported on the lo- 
calization of intellectual functions (6, 8, 9, 
10, 12, 13, 14, 19, 20; 22. 23, 25, 26) and 
these have been criticized for failing to use 
specific anatomical data. This study attempts 


th these important objec- 


Subjects and Procedures 


In this investigation, a brain-damaged group 
was compared with a control group of 
chiatric patients, Each 
male patients from the 
tion Hospital in the Br 
death and Post- 


tests were admin in-damaged 
patients from on five months 
prior to death, the Median he; 
months. The tests 
patient was, 
both neurologist and Psycholo, 
ehough physical and mental c 
tested. 


The same battery of tests was given to the 


t, in good 
Ondition to be 


Robert S. Morrow and Joseph C. Mark 


satri ho 
control group from the psychiatric ae i 
were matched for age, education, anc a a 
The results of this matching as giv 


zi- 
= Table 1 show that both groups were nee 
„mately 40 years old and had about 10 y 


of formal education. Individual matching i 
Occupation was not considered ee un- 
cause most of our patients come from shiatrie 
skilled occupational groups. The psyc chizo- 
Patients were either neurotic or mildly testing 
phrenic but were not at the time of f 
receiving any physiological therapy. tients, 

Of the group of 22 brain-damaged pagi i 
18 had direct involvement of the Ol (eee 
Temaining 4 consisted of 2 subtentoria tumor 
terior fossa) and 2 third-ventricle were 
cases. Eleven of the 18 cortical cases 
considered focal in that the lesion, oe 
of size, was circumscribed; these were diffuse 
tumors. The other 7 were considered as al 
in that most or all of the cerebrum eculat 
fected, resulting primarily from he i 
toxic, or infectious disease. Of the 18 while 
esions, 4 were anterior (pre-Rolandic), po. 
14 were predominantly posterior Mais, 0 
landic and pre- and post-Rolandic). here; ’ 
these 18, 8 were in the left ere br 
were in the right hemisphere, and sa right 
lateral. All patients had a history jnatio™® 
handedness, In making these determ E 
we were assisted by a Teurnlogist wi reports: 
from the autopsy and neurologica micro" 
The autopsy reports cies to find- 
scopic as well as gross brain examina 
ings of the pathologist. 


? 


rtc, 


Results test 


The Wechsler-Bellevue intelligent PMD 
scores for the brain-damaged and Pa 1. 7 
control groups are presented in Ta for 4 
addition, the Wechsler-Bellevue seo are pre 
normal patients were available an her com” 
sented in the last column for ieee of am 
Parison. These patients, tested as an 
other study which required norma ad 
were recuperating from minor ee \ 
appendectomy, tonsillectomy, etc.) i psychi- 
no history of either brain damage 0: ised jn 
atric difficulty. They could not Po they i 
this study as normal controls Daa and 
had received only the intelligence tan the 
also because they were younger 


trols, 
j.en 
ue d 
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meih damaged group. The data for this group 
some ion for the benefit of those who desire 
than Ean of normal reference point other 

A e standardized norms. 
ae 4 be scen from Table 1, the brain- 
Sa a e eup is significantly lower in Full 
cantly E Performance IQ, but not signifi- 
tect | oner in Verbal IQ. Most of the sub- 
Tnfomiati. with the exception of Vocabulary, 
Ward, a r Comprehension, and Digits For- 
damaged ge Acantly lower for the brain- 
e perf &roups. This is particularly true for 
Patients parana tasks. The brain-damaged 
With an Ced worst on the Digit-Symbol test, 
four of er Weighted score of 4.23 and 
Scores, Q e subjects making zero weighted 
Score of rhe: other hand, the Vocabulary 
Same as a e brain-damaged group was the 
Cabular € controls, indicating that the vo- 
Parent function in brain damage was ap- 
etforns, unimpaired. On the whole, the low 
igit oe test scores together with low 
robor, Pan, Arithmetic, and Similarities cor- 
ated, the psychometric test patterns of 


Organ: ; t 
ite brain pathology as reported in the 
re, 


able 2 compares the 11 focal cases with 


Table 1 


Wi 3 
Schsler-Bellevue Intelligence Scale Scores of Brain- 
amaged and Psychiatric Control Patients 


Mean score Arca 
yy brain. Psyghi- u es 
‘ari, jamage: atric es 
Age Liable (N =22) (N =22) lad p (N=45) 
Wu == Eso 
i 82. -305 
Weehehoa ioo a 3809" 075 | — 
Ver,spais 19° oros 108.85 3647 (001 Haz 
i 106.76 1.8 — . 
Subtesrmancero 87.49 109.67 4804 (001 111-0 
Scores Cighted j 
i Sent 
Con Mation 9.41 1036 1571 E A 
Digi?gehension 986 11,00 1.356 wi 
total wei 05 ‘ 
{etal weighted) 6.68 9.14 2.081 ¢ 
pits. coo vard 626) San a 
igi Tect) 5.73 ja 
(S Backward 4 2211 (05 5.6 
Arithmorrect) 3.91 sot 3781 (or 105 
Simitargtic 7.09 1035 2390. (05; ILI 
Voosatities 7.64 ob Cpa eg | cre 
Diggabulary 1105 10: 
paent “Tenge: ge Tongi 2122) COD pI 
Gey : Of 122 
fon Some ya? 10.20 Sioee {or 111 
Obie Design 200, 10.36 3210 foor Ai 
Digit Symbol > 4.23 SL Las j ; 


Table 2 


Wechsler-Bellevue Scores for Cases of Focal, Diffuse, 
and Subtentorial and Third-Ventricle Lesions 


Sub- 
tentorial 
and 3rd 
Focal Diffuse ventricle 
Variable (N=11) (VN=7) (N=4) F> p 
Age 37.73 50.71 30.50 5.71 (.05 
Wechsler-Bellevue 
Full 10 90.09 87.57 105.25 56 — 
Verbal IQ 95.73 95.71 106.50 64 — 
Performance 10, 85.64 82.28 103.00 1.82 — 
Subtest IQ equivalents 
Information 97 98 105 
Comprehension s 102 96 109 
Digit Span (Forwar« . 
& Backward) 86 93 101 
Arithmetic 85 92 103 
Similarities 87 89 106 
Vocabulary 106 104 106 
Picture Arrangement 93 83 100 
Picture Completion 89 92 97 
Block Design 90 85 106 
Object Assembly 90 74 113 
Digit Symbol 70 84 94 
*df = 2/19. 


the 7 diffuse ones. In addition, the 4 cases are 
given in which the lesion did not involve the 
cortex directly, the 2 third-ventricle and 2 
subtentorial tumors. Since there are wide dis- 
crepancies in the ages of these groups, the 
subtest scores are presented as IQ equiva- 
lents rather than as weighted scores. The con- 
version of the subtest scores into an IQ 
equivalent is achieved on the basis of the 
standardization tables in Wechsler (27). Be- 
cause of the paucity of cases, significance tests 
could not be made. 

There is seen to be very little difference be- 
tween the groups of focal and diffuse lesions 
although both groups showed generally low: 
ered test scores resulting from the brain dam- 
age. In contrast, the 4 noncortical cases 
showed, on the whole, very little intelligence 
test loss when compared with the control 
group. In both the focal and diffuse groups 
the Performance IQ is much lower than the 
vere 1Q. Among the verbal subtests Vo- 
oe ary, Information, and Comprehension 

id not seem to be adversely affected. 

The significance of these findings is that 
the lowered intelligence resulted from the 
cortical damage itself and seemed to be inde- 
pendent of the nature of the damage. It 
tered little whether the lesion = ‘f te 
diffuse when the size of the lesio ee 
what controlled by vi eee ae 
hy y virtue of the fact that 

groups had extensive damage resulting 
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Table 3 


Comparison of Wechsler-Bellevue Scores Between 
Pre-Rolandic and Post-Rolandic Lesions 


Pre- Post-_ 
Rolandic Rolandic 
Variable (N =4) (N =14) t+ p 
Age 39.75 43.64 .53 _ 
2 vue 
WSs 1} Beery 100.25 85.92 1.62 = 
Verbal IQ 105.00 93.07 1.27 _— 
Performance 10 94.50 81.42 1,33 — 
Subtest IQ equivalents 
Information 103 94 
Comprehension 106 100 
Digit Span (Forward & 
Backward) 96 81 
Arithmetic 100 87 
Similarities 92 82 
Vocabulary 110 103 
Picture Arrangement 101 89 
Picture Completion 92 86 
Block Design 100 83 
Object Assembly 9o1 83 
Digit Symbol 79 73 
*df = 16. 


in death. We could find no typical psycho- 
metric test pattern for either the focal or 
diffuse lesions since both show, on the whole, 
the typical pattern of gross brain damage, 
Table 3 compares lesions anterior to the 
Rolandic fissure with posterior lesions. Here, 
too, the subtest scores are given as IQ e 
lents because of the age difference. On the 
whole the patients in the pre-Rolandic or 
frontal lobe group show only slight intel- 
lectual interference, with most of the func- 
tions falling within the average range or bet- 
ter, except for the low Digit Symbol score. 
The intelligence impairment is much greater 
and much more consistent for those lesions 


which are either completely or almost 
pletely in the areas 


fissure, although the di 


tistically significant. Here average or better 


quiva- 


com- 


of post-Rolandic lesions than 
landic ones. While few fr 
were involved in this stud 
these four cases show only 
raises questions about some 
tellectual functions ascribe: 
lobes. 


Direct comparison between lesions of the 


Y, the fact that 
slight impairment 
of the special in- 
d to the frontal 
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left or dominant and right (nondominat?) 
hemisphere is precluded because only vel 
sions were clearly right-sided and Mer. 4 > 
located in the frontal lobes. Instead, Ta | 


p 0 
shows the comparison between eight an 
left-hemisphere damage with eight e 
bilateral. The two right-hemisphere a 
are also shown but not statistically a i 
Despite the lack of statistical signific Jesion 
the findings, the left-hemisphere fora 
showed general loss in Verbal and 

ance IQ while the bilateral group lary, I 
lowered Performance IQ only. V oabi dy ° 
formation, and Comprehension were ™ ain dif- 
unaffected for both groups, but Sae an 
ferences were in the low Digit sym ay 
Span, Arithmetic, and Similarities | 
scores for the dominant ang ee 
and low Digit Symbol, Picture es ae 
Block Design, and Object Assembly 


scores for the bilateral group. 


showê 


Discussion 


cat? 
The small number of cases in cane 
gory precludes broad conclusions oF ten ativ? 
zations. We feel justified in veal the rarity 
interpretations, however, because O lization P 
of the instances where precise Le ie ler 
available through autopsy. ge generally 
Bellevue test patterns in this study 


Table 4 


i Scores 
Comparison of Wechsler-Bellevue ians 
e iitsnfochacs and Bilateral Les! 


petwe™ 


ight 
rish 
Lefi Inet 
eft sphOy 
a ies 
svete Bilateral Pm » @ 
Variable (N =8) (N =8) {06 
Age 37.12 50.00 2.20 35 
7 = 
Cra ne 84.12 8800 S31 fog 
Verbal IQ 87.12 pooo 339 x 
Performance IQ 83.25 78.6. 118 j 
Subtest IQ equivalents ioù 1 
Information 92 A 08 
Comprehension 96 108 
Digit Span (Forward A ui 
& Backward) 80 36 10 
Arithmetic 73 z 132 
Similarities 80 2 106 
Vocabulary 102 o 118 
Picture Arrangement 95 80 40 
Picture Completion 90 E 121 
Block Design 89 #2 1 
Object Assembly 89 (it 
Digit Symbol 71 í, 
ions in | 
3 tesion’y, is 
Neen two right-hemisphere (9's ri 
Noe elias Ee tea Bue Since the Auben no com 
Sato te both lesions being in the front; 
sons are made. 
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con 
ee test patterns of most of the other 
differences. ar (21, 27). Some of the slight 
ample Ales worthy of comment. For ex- 
amaged e 3, 4) studies of both brain- 
scores slight] brain diseased patients obtained 
ut he led igher than those of this study, 
sumably fen patients who were pre- 
out-patient cli ier since they were seen in an 
Sper pone. Alta and be goor (O) 
entire braj echsler-Bellevue scores of their 
classified ni si population with those 
Cases, The mild, moderate, and severe 
Stoup bear scores of the severely injured 
seems t very close resemblance to ours. 
ent of the ti re, that the severity or ex- 
Wechsler-B 1 rain disturbance influences the 
Paired Stra ds test pattern. The unim- 
Ness as ey ulary score confirms its useful- 
Pacity as ee of premorbid intellectual ca- 
Others oo by Babcock (7) and 
© involved 27). Other factors which might 
Upon the in the patterning are contingent 
e locati nature of the disturbance, such as 

er of the lesion, etc. i 

Parently 2 the lesion is focal or diffuse is aP- 
e effect., very little importance insofar as 
echsle of severe brain disturbance on the 
What s t-Bellevue test results is concerned. 
itselg a ems to be of importance is the cortex 
€sions evidenced by comparisons of cortical 
sions Ha subtentorial and third-ventricle 
agreem ur findings seem to be in substantial 
i ent with those of Anderson (5, 6) who, 
“focalized” 
hemisphere 


tas nondominant ones, reported a higher 
sler-Bellevue Deterioration Quotient for 
a teri aascic ar cases. He also 1- 
ama that cases with dominant-hemisphere 
While thee” a greater loss of verbal abilities 
gr e nondominant-hemisphere cases show 
Snags loss in performance. McFie and 
Sided 1 (19) found that patients with left- 
i lesions were inferior on the Weigl Sort- 
Sideq a t to patients with nondominant, right- 
tont bec irrespective of location 1m, e 
ound > Parietal, or occipital lobes. Milner 
ing that in left temporal lobe lesions caus- 
to p phasi the test pattern “. - - 15 likely 
telati Oné:of severe deficit on verbal tests and 
(20 vely mild deficit on nonverbal ones 
, p. 55). In our study, six of the eight 


Co; É 
Mparing what he regards as 


Sunsh 
With Ot wounds in the dominant 
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dominant-hemisphere lesions showed some 
form of aphasia yet both Performance and 
Verbal IQ’s were low, the Performance mainly 
because of the Digit Symbol and the Verbal 
mainly because of the Digit Span, Arithmetic, 
and Similarities. Weisenberg and McBride 
(28) showed that right-hemisphere damage 
resulted in lowered performance tests. Milner 
indicated that right temporal lesions in par- 
ticular, as well as right parieto-occipital le- 
sions, interfere with visuomotor functioning, 
mostly in terms of the perception of spatial 
patterns. Since there were in our study no 
right-hemisphere lesions other than the two 
in the right frontal lobes, the left hemisphere 
was compared with bilateral lesions. The bi- 
lateral involvement was generally similar to 
the reported findings on right-sided lesions in 
that the visuomotor tests were lowest, these 
being Picture Arrangement, Block Design, 
Object ‘Assembly, and Digit Symbol. 

Since the left-hemisphere lesions in this in- 
vestigation showed both verbal and perform- 
ance involvement, the question of aphasia 
merits consideration. Six of the eight domi- 
nant-hemisphere cases were reported as having 
some kind of aphasia, while two of the eight 
bilateral cases were reported as showing dys- 
arthria but no aphasia. The speech impair- 
ment did not seem to interfere directly with 
the test administration. The fact that the 
Vocabulary as well as Information and Com- 

rehension scores are either unaffected or only 
slightly so seems to argue against the lan- 
guage disturbance alone causing the gener- 
ally lowered intellectual functioning. 

Research on cerebral localization has been 
concerned mainly with frontal lobe function, 
as in the work of Goldstein (10, 11, 12), Ry- 
lander (22, 23), and Halstead (13). Hal- 
stead, typically, found that intellectual im- 
pairment was greater in frontal lobe lesions 
than in nonfrontal ones, regardless of whether 
ey pet at ee or bilateral, left or 

. Our fin g 
Aa evidence nS a ys an tomda, also, 
H y getting no cor- 
relation between extent of lesion and degree 
of impairment. In all, the frontal lobes were 
mee Deere 
lobes. eing from thefrontal 


288 


In contrast several studies refute the claims 
of frontal lobe function. Hebb (14, 15, 16) 
in his critical review of the work on the 
frontal lobes, as well as his own evaluation 
of four cases of frontal lobectomy in which 
he found no frontal lobe signs, concluded that 
the evidence on which intellectual defects 
have been attributed to frontal lobe damage 
is very poor. Teuber and his co-workers (24, 
25, 26) found that problem solving in pa- 
tients with posterior lesions is at least as diffi- 
cult as for patients with frontal lobe lesions. 
The Mt. Sinai group under Bender, consisting 
of Battersby and his co-workers found that 
the “intellectual changes noted in patients 
with tumors of the frontal, temporal, parieto- 
occipital or even subtentorial areas were about 
the same in quality, although less frequent in 
the last instance” (8, p. 705). They stated 
that “no significant differences between pa- 
tients with pre- or post-Rolandic lesions could 
be found” and concluded that “intellectual 


nt, as some 
authorities are stil] claiming” (8, p. 712). 


Aita and colleagues (1) compared the de- 

i terior and pos- 
patients and found much 
” for the posterior areas. 
was a difference between 
d the posterior ones with 
being, in general, in the 


Plain the disagreements 


t studies one should at- 
tempt to go beyond the problem of undiffer- 


€, ie., chro 


(f) the k 


) 5 functions which may 
be of importance in reconciling the discrep- 


ancies might be the roles of factors such as 
aphasia, personality, and visuomotor func- 
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tion. In other words, the total picture of brain 
damage should be considered. 


Summary and Conclusions 


The purpose of this paper was to deter 
the effect of structural brain pathology on i 
tellectual activity as measured by the wea 
sler-Bellevue Intelligence Scale, Form II. ited 
results of 22 adult males whose death resu E 
from various forms of brain pathology wa 
compared with a control group of 22 poya 
atric male patients. The autopsy ewn a 
reports indicated the nature, extent, an the 
cation of the lesions. The following are 
main findings: - 

1. There appears to be a typical Wechat 
Bellevue test pattern for gross structura a 
thology consisting of significantly lower SS pan 
in Digit Symbol, Block Design, Dish natio 
(especially Digits Backward), Arit scale 
and Similarities. In addition, the Full 
IQ and the Performance IQ, including antly 
the Performance subtests, were signis tion. 
lower for the brain-damaged pape volv- 
There were no significant ditferenees i y 
ing the Vocabulary, Information, an ffecte 
prehension scores. The seemingly una indi- 
Vocabulary score justifies its use as an 
cator of premorbid intelligence. 1 

2. Within the brain-damaged ae 
Significant differences were not found BO 
the focal and diffuse lesions, altos pos- 
groups showed lowered scores. The tw cas 
terior fossa and two third-ventricle air 
showed practically no intellectual ! 
ment. ere 

3. Under the conditions of this study 1 “obe 
is no indication of the so-called fron 5 
signs. On the contrary, patients whose fissu 
were located anterior to the Rolandic se 
showed far less intellectual loss than 
with lesions which were post-Rolandic. 1055 
Post-Rolandic lesions showed the rE c 
and psychometric patterning of gross 
tural pathology. domi 

4. Comparison between the left- T lesions 
nant-hemisphere lesions and bilateral emis 
indicated in general. that the dominant- al 
phere lesions show significantly lower simi- 
IQ (mostly Digit Span, Arithmetic, and ause 
larities) and Performance IQ (mainly Dee ons 
of Digit Symbol) while the bilateral les 


atio? 
wee? 


Intelligence of Patients Autopsied for Brain Damage 


ae lowered Performance scores, in- 
R igit Symbol, Block Design, Object 
y, and Picture Arrangement. 
ore ae are not compatible with the 
the mg brain theories which emphasized 
eas of the frontal lobes and dominant 
Phere in intellectual functioning. 


Received November 5, 1954. 
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The Awareness of Hostile Feelings in Patients 
by Their Nurses 


Sol Charen 


Catholic University of America 


Subjects were 25 male veteran Patients 
hospitalized for six months and longer with 
pulmonary tuberculosis. Mean age was 33 
years with a range of 20 to 56 years, educa- 
tional level was at the mean of 1 
with a range of sixth 


1 From 


duplication Service, 
ton 25, D. C. 
film or $1.25 > 
to Chief, Pho 

gress, 


q out the 


from this 
The col 


three months’ stay they again fille 
Moldowsky and the three nurses 
ward rated them with the Factor H. 017): 
relation was again insignificant (= s of the 

The correlation between the pee group 
first group of nurses and the tose 
was .579, significant at the Ol = the test- 
Scores and sigmas for the patients Ki with the 
retest situation were almost identical, he cone 
correlation between tests being 563 petwee? 
clusion which the above regen ges 5 
nurses’ scores and patients’ scores ating 5- 
that the nurses seem to have been f ugh the 
ternal behavior of the patients alr ternal 
Factor H scale calls for a measure ° obvious 
feelings and attitudes. There is art of Ù 
better than chance ability on the P helt est” 
two groups of nurses to agree T s ho 
mation of a patient’s hostil; esr a 
to really know how he feels "thie su ject 
Despite close association with t idence f? 
neither group of nurses gives test eV 
empathy. 


wey! 


Brief Report 
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i = Period 
Psychological Changes over a Three-Year 1 
Td na Bilateral Prefrontal Lobotomy 


Isidor W. Scherer, John F. Winne, 


VA Hospital, Northampton, Massachusetts 


and Robert W. Baker 


Clark University 


In a previous publication (1), the authors 
reported an investigation of the changes 1m 
Psychological tests of male schizophrenic pa- 
tients during the first year following prefontal 
omy: This paper represents an extension 
of that report to the third year following 
Surgery, 

As has been discussed at length elsewhere 
(1, pp. 1-2), the study was so designed as A 
aki into account several criticisms ra 
may be made of preceding studies of lo = 
omy: (a) failure to control time intervals = 
Ween Successive assessments; (b) failure z 
nse control groups as a baseline in terms x 
Which changes in the operated group ee 
*valuated ; (c) failure to use a wide van A 
= Psychological measures; and (d) a dink. 
tegrate test findings with all available 
data, 


Experimental Procedure 


P ic pa- 
je Stbiects. Fifty white male schizophren' pa, 
‘ents at the Veterans Administration red r 

Orthampton, Massachusetts, re irae jear 
Subjects during some phase ei Jobotomized, 
Study. Of these patients, 28 were 


soti tandard open 
the Operation consisting a vi 6) while the 
, 


Yerly-Poppen approach C trol group- 


Temaini titute 
ee istration, Northampton, 


ini Vi = 
1 From the Veterans eerie this paper was pre 
@ssachusetts. An abs' 


ical Association, 
A Psychologica D 
coy ch eee 54. The authors wish to 
ork, Sep 


Robert Fortier for 

azer and Dr. 

thank Dr. Frank polityjstration of the test battery 
eir assistance in 


and Peña and Dr. Arnold Trehub for 
Dr. Cesareo 


nuscript. 
Critica] review of the m? 


The subjects for the present study con- 
sisted of 20 lobotomized and 16 seg od 
ized patients, fairly well equated Bes e is 
cation, length of hospitalization, diagnosti 
classification, and degree of ee 
All patients had received electroconvu a 
treatment, which was unsuccessful or only 
temporarily beneficial, and all had been s 
lected as suitable candidates for lobotomy by 
the medical staff of the hospital. ; 

Test materials. The experimental materials 
consisted of a.battery of 27 tests from which 
113 measures were derived. A description of 
the tests employed, and the measures derived 
from them, may be found elsewhere (1, pp. 
6-10). Insofar as possible, the test’ battery 
was group administered to the operated pa- 
tients about three weeks before, and two 
weeks, three months, one year, and three 
years after lobotomy. The control group was 
similarly tested at comparable time intervals. 
Tests with published manuals were scored 
according to the prescribed procedure; the 
evaluation of qualitative data was accom- 
plished through group judgment of three 
clinical psychologists (not including the au- 
thors). 

Analysis of data. Each of the 113 variables 
was examined in order to ascertain the sta- 
tistical significance of the et change in the 


.experimental group relative to the control 


group from testing to testing, using either ¢ 
tests or net shift in proportion (for dichotom- 
ized data). The emphasis, Statistically, was 
on determining the net change in the oper- 
ated group over and above the change ob- 
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served in the control group for the Particular 
time period under consideration. 


Problem of the Study 


Four major conclusions were derived from 
the analysis of the data obtained in the one- 
year study (1). These were: (a) There is a 
tendency toward decreased mental efficiency 
at one year, associated Possibly with organic 
alteration; (b) ego boundaries are strength- 
ened, although a downward trend in the di- 
rection of weakened ego boundaries was noted 
in a comparison of the results at three months 


(c) sexual 


toward lack of 
field. 


The problem in 
marily to ascertain the course of the test 


ascertain the 
e experimental group and 


years after loboto: 
material obtained 


2 Tables giving, for each measure, 


td error of dj 
a i s 
in the experimental and con- 


tl 4 
one year after operation to three ahs. ie aom 
tion have been deposited with the Ameri ae 
mentation Institute. Order Document 
ADI Auxiliary Publications Project, oa 4556 from 
Service, Library of Congress, Washington 25, D. C 
remitting in advance $2.00 for microfilm or $3.75 for 
Photocopies. Make checks Payable to Chief, Photo- 
duplication Service, Library of Congress’ 
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additional dimensions of difference bettas 
lobotomized and nonlobotomized schizophren- 
ics over the three-year period. 


Results 


Changes during the period from ong n 
three years following lobotomy. First to r 
considered are changes in those variablen 
lated to the first conclusion from the earli 
study. 


aie 
There is a predictable pattern of test pari - 
ance following lobotomy. Performance on tests nction 
uring mental efficiency and organicity oe 
due to organic factors) drops sharply ye th 
two-week Postoperative period. As recovery ns 
Operation takes place, test performance re hove it, 
the preoperative base line or rises slightly va post- 
reaching a peak, in our study, at three mont towar 
Operation. There then appears to be a trend tests at 
decline, such that the performance in some Jine, al 
one year postoperation falls below the base 
though several tests remain above (1, p. 20): 


ter 

In the period from one to three years oe 
Prefontal lobotomy, a definite parto 
gesting improvement is noted. Of the HAF 5 
ures selected as pertinent to this vjenifican’ 
show a shift, at the .20 level of PERA men- 
or better, in the direction of increase There 
tal efficiency during this time period. tically 
are no measures which show a statis direc” 
significant net change in the negative t 
tion. This over-all result is significant a e 
‘01 level, when tested with x? as des athe! 
elsewhere (1, p. 10). The measures, tied jn 
with the associated b values, are presin score 
Table 1, where H indicates a change in mples 
signifying better efficiency. Thus, for exam’, 
abstraction as measured by the score a to 
Object Sorting Test is improved from: Se 
three years after operation (p < .01); dace 
ory is improved, as indicated by inca 
curacy in Visual Memory (p < .05) an the 
correct recollections in delayed recall "Thus: 
Babcock Memory Paragraph (p < .01). iencY 
the tentative trend toward reduced effici eat 
which had been observed during the et, be 
is not continued, and, in fact, appears 
reversed. und- 

The second conclusion held that ego bO fol- 
aries are relatively strengthened one yea 3 
lowing lobotomy. However, examination D 
the changes between three months and ® 
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Table 1 


, Direction of Net Change in Measures of Mental 
Efficiency from One to Three Years 
Following Lobotomy 


Net 
Measure change t 
Organic Signs 
Mad Association 
a rases (83) = o 
ose (84) = m 
Personal (87) Fa » 
Taw-a-Man 
Shading (69) a 20 
eS) (65) z A 
.teavy Lines (71) = 5 
me Memory 
eavy Li 
Abstraction ee ke 
“Aategorization (57 = 2 
hi aties EN i 5 = 
ipley Hartford Righ H ot 
i r ghts (55) 
Motor Sorting (48) z x 
sever Dexterity (31) a 20 
Unlstens Total Time (37) S = 
ad: Ri Ti ? 
an Mae: Right Hand (38) 
alstead 
es Hands (40) = z 
p.sht Left (41) H 10 
Mone (44) ti $ 
Hard Pairs (0) p p 
tsual Memory be 
H = 


Accuracy (10) 
Fy Par 
mmed. Right (18) = 


Delay Right (21) H .01 
otal Right (24) = BG 
Dost Distortions (19) H a 
Distorted Order (23) H 2 
T Span 
ei; = = 
Cognitive e Score (5) 
igit Symbol 
Errors (1) = ae 
Weighted Score (2) H 
railmaking 
Errors (59) = ae 
erial Seven 
Errors (7) = + 


as 
deNote—The number in parentheses refers to the meas as 
higmed in the one-year report , 6-10). 2. mental 
ener mental efficiency, — in phi 
ciency, ¢ 


» Di 
dicates no chan: 


ewhat un- 
he direc- 
d set in. 
ures, 


Year after operation, although som 
Clear, suggested that a trend in t 
tion of weakened ego boundaries hai 
Table 2, which lists the relevant meas 
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again demonstrates a reversal of trend dur- 
ing the period from one to three years after 
operation. Of 21 measures studied, 8 are seen 
to shift, at the .20 level of confidence or bet- 
ter, in the direction of strengthened ego 
boundaries. One measure, the number of 
omitted items on Word Association, moves 
contrary to the general pattern, with an as- 
sociated p value between .10 and .20. This 


Table 2 


Direction of Net Change in Measures of Strength of 
Ego Boundaries from One to Three Years 


Following Lobotomy 
Net 
Measure change $ 
Memory 
Digit Span 
Forward (3) = = 
Memory Par 


Immed. Right (18) 
Delay Right (21) 
Total Right (24) 
Halstead 
Positions (44) H 10 
Cognitive 
Digit Symbol 
Weighted Score (2) H 05 
Halstead 
Right-Left (41) 
Right-Both (42) 
Vocabulary (17) 
Body Image 
Draw-a-Man 
Accuracy (65) H 20 
Contact Measures 
Rorschach 
Rejections (126) = t 
Multiple Choice Rorschach 
Rejections (138) = if 
Crude C responses (141) <= es 
Szondi l 
p positive (105) a 
p negative (106) aut aa 
Word Association 
Personal (87) 
Omits (82) 
Tweezer Dexterity 
Lev of Asp (30) 
Attitude to God 
Positive (114) 
Negative (115) 
Aversion 
Staying at Home (118) H 20 


| | 
= 


ta me vnl 
a 


Note—The number in parenth 

= es 

defined in the one-year report Gy pp eo eae a 
creased, L indicates decreased, — indicato? ne op dicates 

strength of ego boundaries. ates “ng "hangs in 
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Table 3 


Direction of Net Change in Measures of Sexual 


Awareness and Concern from One to Three 
Years Following Lobotomy 


Net 
Measure 


change p 
Bender Gestalt 


Angle Difficulty (77) H 


.05 
Draw-a-Man 
Sexual Confusion (66) — 
Accuracy (65) H 20 
Nose Size (64) — = 
Draw-a-Woman 
Shift in Breast Size (61b) H -20 
Rorschach 
Reaction Time, Card VI (132) H 01 
Aversion 
Masturbation (122) H 05 
Incest (119) H 01 
Deviant Sexual Behavior (120) H -10 
Note.—The number in parent] jes 
peated. in jie iets Fort, pp. G-to ease as 
srl awareness at conten dates noche 


from .01 to .10), increased Teactio 
Rorschach Card VI (b <.01), 
delineation of the sex in drawin 


figures (p > .10 < .20). Again, thi 


n time to 
and better 
8S of human 
ere are no 


measures which shift in a direction contrary 
© the general pattern. e 
i The fourth netusim maintained that A 
is an increase in the rate of action in ma wing 
ized patients during the first year Patients 
lobotomy—that is, the operated P sively 
tended to act more hurriedly or pe oer lists 
than did their controls. Table 4, ae 
the direction of net change in the 24 ment 
variables, exhibits an interesting ere are 
Changes in three out of four tests ae 0 
Primarily motoric (Total Inhibition 


Table 4 


te of A 
Direction of Net Change in Measures ‘a an 
and Impulsivity from One to Thr 
Following Lobotomy 


ction 


Pp 
e 
Measure chang 
a Mee O O O O See 
Motor 0 
Downey Inhibition H K 
Total Time (36) H i 
T:—T, (37) pn E 
Finger Dexterity (29) H ‘ 
Tweezer Dexterity (31) 
Cognitive 05 
Digit Symbol H : 
Weighted Score (2) a 
Serial Seven EN 
Time (6) P 
Word Association 5 
Time (88) ; 
Rorschach Reaction Times L a5 
Card IIT (129) L “30 
Card IV (130) L ‘OL 
Card V (131) i 05 
Card VI (132) L “30 
Card VIT (133) É 0 
Card VII (134) L to 
Card IX (135) L : 
Card X (136) 


A - 
Aversion Items 


Murder (116) 7 2 
Theft (117) i D 
Incest (119) A 2 
Deviant Sexuality (120) pad as 
Withdrawal (121) i. 0 
Masturbation (122) eas i 
Cannibalism (123) 
Expansiveness ot 
Visual Memory L ’ 
Size (11) 5 
Draw-a-Woman L 0. 
Size (60) a 
measlle es 
Note.—The number in parentheses refers to the 


indicate 
H ind’, i 
ja the oneiveat feport is pec C0. A, ladi 
grained inie indicates decreased, + indicates no Cl 
rate of action or impulsivity, 
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oe Will-Temperament Test, the dif- 
the Dow etween the first and third trials of 
terity ea and the O’Connor Tweezer Dex- 
action rol suggest that the rate of motoric 
feces oe to increase during the period 
Perhaps hi three years following operation. 
in Digit Soen to this is the increased score 
volves g ymbol, a written test which in- 
hand ie eed of motoric action. On the other 
reaction a data obtained from all Rorschach 
and fou imes, two measures of expansiveness, 
social ae out of seven measures of moral- 
tients be itude suggest that lobotomized pa- 
act ra ag igs impulsive and less likely to 
aeit y in tests involving ideation Or 
lon. 

Voie ee to this point, we see that 
rey: patients show the following net 
after i the period from one to three years 
in teat peration: (a) a general improvement 
enin, p mental efficiency; (b) a strength- 
Fon ego boundaries; (c) a continued in- 
Crease FIN awareness of sexuality; (d) an m- 
inhibiti rate of motoric action; and (e) more 

ition or a lesser readiness to act rapidly 


on i : : 
et involving imagination or ideation. 
kanges over the three-year period. This 

ar with 


aoe has been concerned thus f 
ie attributable to lobotomy with refer- 
foll to the period from one to three years 
t Owing surgery. Next to be considered are 
bls changes over the whole time span em- 
ome ees from immediately before lobot- 
a to three years following lobotomy. Very 

m aay, tests of significance of the net change 
the operated group indicate that only 4 of 

€ 113 measures show impairment which is 


Statistically significant at the .20 level or 
etter: Digit Symbol Errors, Trailmaking 
and Aver- 


ing Word Association Omits, 
ion to Cannibalism. Twenty-three measur?S 
Show significant net gain, while the remain- 
ing 86 measures show no change. Since these 
Tesults differ from a chance distribution at the 
OL level, it may be concluded that the op- 
erated patients either held their own or Ol 
etter on psychological tests over the three- 
Year period than did their controls. 

Since the interpretation of many of the 113 
may be open to question, 4 group 


Measures ; 
t measures of functional efi- 


of 40 clear-cu 
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ciency were analyzed in detail. Table 5 pre- 
sents these measures, the direction of change 
within the experimental and control groups 
for each of the four testings after operation, 
and the zet change in the experimental group 
over and above the change in the control 
group. All changes shown are statistically sig- 
nificant at the .20 level or better.* 

The data presented in Table 5 suggest that 
the experimental group, except at the second 
testing, tends to have better efficiency than 
evidenced prior to lobotomy. For example, 
three years after lobotomy, gains are shown 
in 24 tests, no change in 12 tests, and deficit 
in only 4—increased errors on Digit Symbol 
(p < .05), increased errors on Trailmaking 
(p < .10), and increased confusion in se- 
quence for immediate and delayed recall of 
the Babcock Memory Paragraph (p > 10 < 
.20). The control group, on the other hand, 
shows considerable gain when tested for the 
second time, probably as a result of practice, 
but by three years has returned essentially to 
the level attained at the beginning of the ex- 
periment. 

The final section of the table indicates the 
relative loss in efficiency of the operated 
group two weeks after lobotomy, followed by 
a slow but steady rise over the remainder of 
the three-year period. We believe that the 
failure to improve in tests of functioning effi- 
ciency—in spite of repeated exposure to the 
test materials—on the part of the nonoper- 
ated group is one aspect of the regressive 

8 Tables giving, for each of the 40 measures, the 
number of cases, means, the standard error of differ- 
ence, t, and for the changes within the experimen- 
tal groups and for the net change in the operated 
group for the periods (a) Pre-2 week post, (b) Pre-3 
month post, (c) Pre-1 year post, and (d) Pre-3 year 
postoperation have been deposited with the American 
Documentation Institute. Order Document No. 4557 
from ADI Auxiliary Publications Project, Photodupli- 
cation Service, Library of Congress, Washington 25 
D. C., remitting in advance $1.75 for microfilm Se 
$2.50 for photocopies. Make checks payable to Chief 
Photoduplication Service, Library of Congress. A 

4 It will be noted that there is considerable over- 
lap between the measures presented in Table 5 and 
those presented earlier in Table 1 and Table 2 
Table 5 includes all measures adjudged to Ei k 
paoa interpretation while Table 1 E 
include only those measures which showed signifi- 


cant net change at some i i 
years following lobotomy. ee E EE 
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seline in Forty Tests of Functioning 
ciency over a Three-Year Period 


Net change 
Experimental group 


Control group 
Measure 


Digit Symbol 
Errors (1) 
Score (2) 

Digit Span 
Forward (3) 

Reversed (4) 
Weighted Score (5) 

Serial Sevens 
Time (6) 

Errors (7) 

Hard Pairs (9) 

Visual Memory Rights (10) 

Vocabulary (17) 
emory Paragraph 
Immediate Rights (18) 
Delay Rights (21) 
Average Rights (24) 
Immediate Distortions (19) 

elay Distortions (22) 
Verage Distortions (25) 


mmed. Distorted Order (20) 


3yt 
lyr. 

k. 3mo. 

2wk. 3mo. lyr. 3 yr, 2wk. 3mo. lyr. 3yr. 2wk 


Pa Wi 
m| 
I | 
=] 
| 
| 
Nee eta 


I1] 
Ham 
ele 


Li a ae | 
[| Rem el] 
\\ \ a 


[me] | 
[em] | 


SIRI) ley ye 
PRAT] | dg 
lIl tiame 
Seeli 
ANTAN AY yey, 


3 
gS 

WF 
AACA MAY 


WET 
E E Pees 1 suka ia | 


VS yl att 


[TREH | | phevestinittet | poet pe 
PD PREY YY bp eee tap ot yp |g RB] bles 


[1 tay 


Object Sortin 

Score (48) 

Confabulation 49) 

Symbolism (50) 
Similarities (51) 

eries Completion (53) 
S] ipley Hartford (55) 
Categorization (57) 

railmaking 

Time (58) = 

Errors (59) i 
D-a-W Confusion (62) H 
D-a-M Accuracy (65) =a 
Confusion (66) H 

L 


PRR] imn AL | et] ee] m PTTL] Ste mm 
BEAL \\ \ 


PACE we LANL LT fie ey pe an 


MEERI pE eee SIR] Lolo] ee E 


LIIIN Mimmy 
| 


[oat] | | 
AREY] | | 
Let) ey 
Ll mlide 
VeVi i iy 


for: IEN 
KER IE] 


Bender-Gest, Elaboration (75) 
Word Association Recall (81) 
Number of Measures showing 
Gain ak eon 48 — 13s A Yi 
No change 3 4 17 42 21 E2 993 
Loss 4 3 


1S] my] | a 
| REY Bt te | 
LTT | bey 
eo 
Pept pee] 
[| mel | | 
B\ RRL \ 


PRESE p| 


CIE. i 
25 23 a) 
13 7 


38S MEO] | | 


Note.—The number in parentheses 


sede 
inerea! 
efers icates inc! 
o the mi pp. 6-10). H indici 
indi, cl oy Sasure ag in the one-year report (1, pp. 
L indicates decreased, indicates no hange in functioning eet a gin 
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ch s 
eoa schizophrenia. Further study of 
Biles nt differential in this aspect of the 
data rnan ss is now underway, utilizing 
after lobotomy rom the two groups five years 
dditi w 
and muignal differences between lobotomized 
Sults which h omized schizophrenics. The re- 
een large] pili been presented thus far have 
vey a ad spa in nature and con- 
botomized 3 favorable connotation for the 
study of the ts nont: However, qualitative 
controls pat avior of operated patients and 
activity mee the testing situation, ward 
Suggests that mm group and activity therapies 
group is née ea certain respects the operated 
Although 1 b Oing as well as the nonoperated. 
more coon  tomized patients appear to be 
childishnese 1? they exhibit a great deal of 
oriented hes of motivation, lack of goal- 
and irreg enavior, concreteness of thinking, 
do not sponsibility —modes of behavior which 
Merous li to be related directly to the nu- 
lning est measures associated with func- 
tion o mental efficiency. Moreover, examina- 
indicate po triste progress notes does not 
Ment j at there is greater clinical improve- 


controls ° lobotomized patients than in their 


Te; 


Discussion 


Th 
Present ey portion of this report will first 
the findi tiefly some possible explanations for 
eff; tings of increased cooperativeness an 


Cl = 
Pare T in the lobotomized patients. The ap- 
discrepancy between test performance 
i d in the 


Dr vigqical status which was note 

Pir US section will then be considered. 
tion St, it appears that the immediate reac- 
of patients to the operation includes fea- 
S such as would be found jn any indi- 


idy Leet 
l Sufferin auma. Immediately 
after ing cerebral tr ; ind 


taps, [Obotomy such typical ors 

orions as increased irritability, concreteness; 
Usion, temporary release of Sai 
ser, 1 temporary defensive regression ect 
woe’: It appears that some of these factors 

Ct wi « onment W. jc: 

Prior ee = onan he increased contact 
allows o e Bie for social interplay and 
Tesults R PO reakdown of prelobotomy tend- 
cies toward isolation: 
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A second factor to which we may point for 
explanation is the commonly observed reduc- 
tion, following lobotomy, of anxiety asso- 
ciated with pathological preoccupation. This 
diminution of anxiety seems to remove the 
need to create new symptoms or to introduce 
other defensive measures, and so releases 
psychic energy for employment in the solu- 
tion of reality-related problems. This could 
account for increased efficiency on psycho- 
logical tests. 

Third, it is possible that the reduction in 
the strength and number of morbid symp- 
toms is in part the result of some degree of 
disorganization or interruption of ingrained 
thought processes which created the patho- 
logical defenses. In addition, the pathological 
defenses per se become “shaken up” by the 
organic assault so that they do not operate 
as effectively. Consequently, the possible dele- 
terious effect of these pathological defenses on 
functioning efficiency is reduced and, con- 
comitantly, the opportunity is created for 
new modes of expression of psychic energy. 

Despite the increased efficiency noted on 
psychological tests, qualitative study of the 
clinical behavior of lobotomized patients does 
not appear to show the same positive gains. 
In part, this may be due to lack of clear 
knowledge of what the tests measure. Al- 
though memory, abstraction, contact, etc. are 
defined operationally, there is no certainty 
about the relationship of the definitions to 
their corresponding clinical concepts. More 
importantly, there appears to be no reason 
why performance on psychological tests should 
parallel that behavior which is considered in 
judgments of clinical status, since the latter 
represent different facets of the total per- 
oa ara ee for measurement, 
n differen 
pane to fais na tego! uae 

gence, cooperative- 

ness, and the amount of psychic energy avail. 
able for use in the solution of the A 
hich ne problems 
which are presented, while judgments of clini- 
cal status depend upon a host of variabl l 
many of which are ill defined or in th riables, 
of subjectivity. e realm 

Mor 
a ee ak oot gamin 
ized patient is maki erame he larotom 
tacts with his envi Rechte os A 

vironment and is likely to be 
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more demanding on the ward personnel. In a 
sense, symptoms which are ordinarily en- 
capsulated. are more likely to be released and 
expressed following the operation. Because of 
this, observers are more apt to notice the op- 
erated patient’s Psychotic ideation and be- 
havior than those of his less demanding and 
less active control and, consequently, adverse 
clinical judgments may be made. 


Summary 


All lobotomized subjects were 


group tested 
about three weeks before 


Toup for the 
to three years after op- 


The results are as follows: 
1. Lobotomized pati 
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: Py rill 
(d) an increased rate of motoric eae to 
(e) more inhibition or a lesser i 
act rapidly on tests involving imag! 
ideation, id bet- 

2. Lobotomized patients generally did a 
ter on psychological tests over the 
period than did their controls. cept at ig 

3. Lobotomized patients, excep tend t0 
testing two weeks after lobotomy. aged 
have better efficiency than that F 
prior to lobotomy. + arable 82 

4. Control patients show eagle of the 
on the second testing, but at tlie sentiall (9 
three-year period have returned a expel 
the level attained at the aan r ck of I” 
ment. It is suggested that this ae tsi 
provement in spite of practice On an o 
one aspect of the regressive C izel 
schizophrenia. h Jobotom i, 

5. Qualitative analysis of the a of PSS 7 
patients’ behavior and eramu in so 
atrists’ progress notes suggest ot doing 
respects the operated group is 4 grouP” gi, 
well clinically as the nonoperate crease £ 

6. It is suggested that the evidence A 
ciency on psychological tests (a) incre fo 
the operated group is due to hich le 
contact, (b) lessened anxiety Watton f ar 
psychic energy for use in the so disorg® nt 
ality-related problems, and (c) as a 1 
tion of the pathological defenses 
of the organic assault. 

t It is suggested, also, that o psy¢ af 
ancy, in the operated group, De eepasitt w 
logical efficiency and clinical be nd dine 
be due to (a) ill-defined test and i, a 
measures and (b) release of x may Ai 
capsulated symptomatology whic observ? 
courage adverse judgments by war 


disor 
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Diagnosis of Organicity by 


Means of Spiral Aftereffect 


A. Cooper Price 
VA Center, Biloxi, Mississippi 
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One of the persistent problems facing @ 
clinical psychologist working in a hospital 
ae is that of having a reliable and valid 
est for determining organic brain damage- 
be reports on the more frequently used 
ests such as the Rorschach, Wechsler-Belle- 
ie and others tend to cast some aint Of 

eir ability for consistent differentiation © 
aie from nonorganic cases (9). ‘ched 
a + 1949, Freeman and Josey (1) care 
Fé Study in which ability to perceive a certain 
pral aftereffect by patients with memory 
Mpairment was investigated. They rotated an 

tchimedes spiral for a period of time on 
3 Ich rotation was stopped. Normal ae 

XPerienced a visual negative afterimage © 
ect of either expansion oF contraction . 
Ps Spiral immediately after the rotation r 
ha PPed, This apparent movement aitere a 
aS been referred to elsewhere as d 
th ment (3). Freeman and ren 
cay. Most of their subjects Ge) We t re- 
ally judged memory impairment ST inc- 
Port or were unable to perceive this ies 
"Ve aftereffect. 

he results of their study led menon 
thors to believe that this en a tech- 
'ght be utilized for developman in involve- 
Que for detection of Ore E t nonorganic 
ent, Tt was hypothesized tha 


R istinc- 

Patients would be able to pace M, epe- 

WVe aftereffect while organie ipement, would 

cially those with cortical ae they did per- 

= unable to perceive i oe it would be in- 

ces — Ee ed that Cra sooi 
e T to verify this hypothes , 


the present 


ny 


results were favorable, to develop this tech- 
nique as an aid for diagnosis of organicity. 


Method 


Apparatus. An electric motor and stand 
commonly used for color mixing experiments 
was used to produce the necessary rotation. 
To the shaft, an opaque disk of white plastic 
6 inches in diameter was attached. An Archi- 
medes spiral of 920° or 2% circuits about 
the center was constructed of dark colored 
plastic and was placed against the white disk 
background. The spiral was reversed for the 
effect of opposite rotation. The disk was 
turned at approximately 100 revolutions per 
minute. It was later found that a spiral could 
be rotated on a phonograph turntable of 
78 rpm with identical results. , 

Procedure. Testing took about five minutes 
per S and was conducted only in the daytime 
when illumination was good. The S was seated 
approximately 8 feet from the apparatus. 
Standard instructions were given immediately 
preceding the test as follows: “This is a spe- 
cial eye test (so stated in order to get at- 
tention and cooperation from psychotic Ss). 
Look at the center (pointing) and don’t take 
your eye away until I tell you to.” Then the 
rotation was begun. Spiral A, giving normal 
Ss a negative aftereffect of expansion, was 
presented first in half of the cases for 30 sec- 
onds. This was ample time for normal and 
other Ss. While the disk was rotating S was 
asked “What does the line appear to be do- 
ing?” This was done to make sure S was at- 
tending and could report his experience. After 
30 seconds, the disk was stopped and S was 
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then asked immediately, “Ni 
line appear to be doing?” 
Swer was recorded, 


The routine Was repeated 
with 


dimension oc- 
Parent motion forward 


Mquiry for scoring There was 
little ambiguity as to the Presence or absence 
of the aftereffec i 


© scores in final computa. 
tion. 

Strict adherence to the Procedure for the 
testing of Ss was exercised, It was believed 
that variations from the standard irections 
might have considerable bearing upon the ya. 
lidity of e results obtained, Precaution was 
aken t Suggest or Structure In any Way 

Table 1 
Aftereffect Score 
Perception 
E wee 
None Partial Siete 

Subject —. ea 

group Score 4 2 3 l A eoe 
Normal 0 1 0 2 37 

(N=40) 0% 2.5% 0% 5% 92.5% 
Nonorganic 

Psychiatric 0 0 1 1 38 

(W=40) 0% 0% 2.5% 2.50%, 95% 
Organic 72 13 24 9 2 

(= 120) O% 10% 20% so 2% 
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, ing invest 

the nature of the perception being j 
gated. the percepti 
In order to demonstrate méid and 10 
aftereffect to be cortical = were teste 
retinal (2), several er ond Gh pe 
with one eye covered. At pe rotation i 
Second exposure period, t we instruct 
stopped. At that time the en used to ve 
to cover the eye which had a the otia 
the rotating spiral and om Tt was foun’ 
view the now motionless vate me same 
that the aftereffect occurred j fae oul 

Subjects. The VA gg at Bh iy 
Mississippi and the VA ae this st 
Mississippi, supplied the Ss an 
Three 8roups were used: - employed Fi 

1. Forty normal adult a testing, Wi 
the institutions at the time o Ivement: pe 
known history of organic Aa aR cases k 

2. Forty nonorganic EU oi hospita wat 
diagnoses of these were base need Gh Bi: 
action. The group was ree neu vin 
Phrenics, manic-depressives, a undergo ip 
Patients recently or — EE Ha E of 
electroconvulsive treatment eae this fora 
the study, since it is known rary 0'8 
treatment may produce temp s as 
Pee inant and twenty S Diagnos 
with known cortical aye ae ens 
of these cases were based eles of nit 
action. This group include agentes 
syphilis, cerebral vascular ac ith alco nce’ 
brain syndrome associated feet i cgin- 
cerebral arteriosclerosis, pos ages of Pa 
Phalopathy, and advanced s g 
son’s disease, 


Results 


S g 

Scores of Ss in the three E Table i 
centage computations are give anie f 

The chi-square technique ‘statistical od 
termine the Possibility of a a ie mic ost 
nificant difference between cee for ro! 
the nonorganic cases. Chi es at the ¢ 
data was found to be significa 
level of confidence. 


and 


Discussion resi j 
iatric cases were p. tes 
ional psychiatric ca Tr A 
P brain dugie in t 
da a ARRA this hypothesis, case 
ata c 


pe 


y 


t 
f 


Diagnosis of Organicity by Spiral Aftereffect 


group being 

a ion le to perceive the aftereffect to 
tional Psychiatri The normal and the func- 
ifference į vatrice Ss showed no significant 

Standlee 1 their performance. j 
on the Sebel ee published an article (7) 
Memory im aftereffect as an indication of 
ng from ribet with conclusions differ- 
and with impli of Freeman and Josey (1) 
ministered m ications from our study. He ad- 
5 Psychotic > spiral test to 16 normal and 
© Perceive th s and found that all were able 
ame Ss th e aftereffect. He also gave these 
that ae Memory Scale and 
from. bel Memory Quotient scores 
“nd upper 1i below 48 to above 143, lower 
Indicating ts Of the scale, with low scores 
Scores ieee memory ability and high 
sone ie superior memory ability. He 
bi ity Scor, m this wide variation in memory 
of each of hi and from the aftereffect report 
Strong pr b ìs Ss that “Freeman and Josey’s 
visual p 2 ability of correlation’ between the 
Confirmeg» enon and memory ability is not 
Sver, mad (7, p. 317). Standlee has, how- 
MterPret e a crucial error in his reading and 
for ey ation of Freeman and Josey’s study, 
temptin, Pecifically stated that they were at- 
Not with: to deal with memory impairment, 
istin, Variations in general memory ability- 
Ction exists and must be made be- 
hing two conditions. A given individual 
e suffe low memory ability and may not 
oF mem, ered from any type of brain damage 
Ory impairment. One of our nonor- 
peychiatric Ss, for instance, was 4 pri- 
ao defective, and he was able to 
; the aftereffect completely: a 
inina nd part OE his study, Stand te 
8s ap ered the same tests to his psycho 
Ceiyip, OXimately eight hours after m ri ; 
g one electric shock. On the spira re 


i 
twe 
Ma; 
hay, 


Banie 


Dercej 


teg 

cle he found two reporting incomplete ane 
& Percepti th 23 reporting 

Xp ptions with F eptions: Ta 


‘andj i 
hi ding and contracting P ns. ] 
me retesting for evidence of memory Impa 
Nt, he used the same form of the es 5 
t mory Scale as previously used and oa 
higneverage MQ score for me aoe ig Ry 
er th pock On te > 
hese ano be T ed that electric shock 
id not impale memory ability or the ability 
i t. 
experience the spiral aftereffec 
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This second part of Standlee’s study is also 
open to criticism. First, his results do show 
that electric shock had some effect on percep- 
tion of the aftereffect since two of his post- 
shock Ss reported incomplete perceptions, and 
it is open to question as to how many of the 
other twenty-three drew upon or utilized their 
previous experience with the test in giving 
their reports on retesting. Practice effect may 
have been operative here as well as elsewhere. 
Second, use of a single shock likely had mini- 
mal effects. Had more been used, results 
would likely have been more marked as has 
been shown by other studies (4, 8). Third, 
as he himself admits, the use of the same 
form of the Wechsler Memory Scale for evi- 
dence of impairment is faulty because of prac- 
tice effects, thus leaving him with no ade- 
quate criterion of memory impairment. His 
study would have fared better had he used 
in his postshock testing Form II which 1s 
available and which was used effectively by 
Stone (8). 

While we 
lationship bet 


did not set out to verify the re- 
ween memory impairment and 
the spiral aftereffect, our findings and con- 
clusions, for reasons stated above, are more 
in agreement with those present in the study 
of Freeman and Josey than those of Standlee. 
We are in agreement with Standlee’s study 
insofar as we both found psychotic Ss—ours 
specifically diagnosed as functional or non- 
organic—as being able to perceive the after- 
effect. His study, however, did not deal ade- 
quately with the impairment factor which 
may be of organic or of functional origin. If 
impairment exists and if it is of organic 
origin, we predict difficulty or inability to 
perceive the spiral aftereffect. 

In summary, our data for the organic cases 
contrasted significantly with the nonorganic 
in the direction of expectancy. When failure 
to perceive the aftereffect is found, it is al- 
amet jaa that cortical involvement exists. 

p! anation of our significant results in 
psychophysical terms has not 
see ë yet been worked 
c stablished. Some leads may be f 
in Saucer’s article on processes of a ai ah 
ception (5) and in Shapiro’s iets Ago 
perception of apparent motion (6) _ pi 
Pea to believe that motion orks te 
7 i 
erived from a higher-level integrating = 
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synthesizing process in the central nervous 
system, this integrating or synthesizing proc- 
ess appearing to be adversely affected or non- 
existent in individuals with organic brain in- 
volvement. Shapiro believes that the percep- 
tion of apparent motion is related to an “jir- 
radiation of excitatory effects” (6, p. 58) 
and that there is “an exaggeration of inhibi- 
tory effects in brain damaged patients” (6, 
P. 67) which weakens or destroys motion per- 
ception. While adequate explanation of the 
Phenomenon remains to be hypothesized and 
verified, the results are such as to justify 


Present clinical use of this technique in diag- 
nosis of organicity. 


Conclusion 


Received November 19, 1954. 
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The Efficacy of Diagnostic Pattern Analysis 
with the Wechsler-Bellevue™ 


Jacob Cohen 
VA Hospital, Montrose, New York and City College, New York 


Sing r 
for the a publication of the revised manual 
more A i scales (5), and 

ennin arly, since the publication of 
tempted to cal group (4), clinicians have at- 
and clinical taw inferences about personality 
ifferences , diagnosis from the intersubtest 
Practicg of Wechsler-Bellevue records. This 
analysis, variously referred to as pattern 
SIS, hag alien analysis, and profile analy- 
clinica] fi any enthusiastic proponents in the 
ably ae It has developed, in a remark- 
ote with time, an enormous research litera- 
Req results which have been character- 
y Westionable ma 5 -g conflicting, oF 
; P- i 
alysig idence for the validity of pattern 
Which t comes mainly from researches 1M 
tient, „ © Scores of criterion groups of pa- 
Subtest he compared with those of controls, 
COvereg yy Subtest. Significant differences dis- 
Offereg „J £ test are harvested and are then 
he differentially diagnostic signs. 
2 lidity of pat- 
nds of in- 
arl- 


Ae Vidence against the va 
alysis comes from several ki 


Vest; = 
Son, ‘ations: (a) subtest-by-subtest comp 


(a like those cited above which have failed 


ter 


cati luce significant differences; (b) appli- 
Sign ns of previously adduced patterns oF 
i jth failure to sub- 


on new samples W 


ae : 
reste them; (c) reworking of data prev" 


of differentiating 
in fact, no such 


1p, jon, Neuropsy- 
>From ee nology Section, x 
c th cl z i 
attic e E E ministration Hospital, 
: PBR, New York. cknowledge the coopera- 
. ae as whee Chief Psychiatrist, and 
ee ir. H, Le ee hief Clinical Psychologist, 
Gn vA Hospital: e also appreciates the ef- 
S of the seven clinical psychologists E l 
Subjects, 


tio 


-of 
B: 
fori d 


The approaches of the researches described 
to the problem under question are indirect. 
The presence of significant differences be- 
tween groups on some subtests is no guarantee 
either that the matching of the groups has 
been complete enough to remove the effects 
of extraneous variables, or that these differ- 
ences are large enough to lead to fruitful ap- 
plications on individual cases. The absence of 
significant mean differences does not preclude 
the possibility that two obverse patterns, 
either of which is identifiable by a clinician 

ingle diagnostic group, 


as pertaining to a SI 
may not cancel each other out and lead to 


differences which fail of significance. Witten- 
born’s (6) demonstration with Rapaport’s 
data that pattern correlations within diag- 
nostic groups are no larger than those be- 
tween diagnostic groups—in the present au- 
thor’s opinion the clearest and most definitive 
attack on the problem—still leaves a logical 
loophole in that the clinician may differently 
interpret the same pattern when the level of . 
the constituent scores varies. In all prob- 
ability, this loophole does not loom very 
large from a practical viewpoint. Still, Wit- 
tenborn’s approach to the problem is an in- 


direct one. 


The Problem 


When directly stated, the question which is 
basically at issue is, “Can experienced clini- 
cians, using only the Wechsler-Bellevue sub- 
test weighted scores and the verbal, perfor 
ance, and full-scale IQ’s, make nodio ical 
diagnoses of individuals which are si aie 
cantly related to neuropsychiatric ee: à 
ae If they can, a second Giestion of 

ree i i 
me = T E arises and is of practical 
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Materials 


In the course of another investigation (1, 
2), Wechsler-Bellevue data (eleven subtest 
weighted scores and the three IQ’s) for 300 
successive admissions meeting research cri- 
teria were gathered. These data were made up 
of groups of 100 cases each of neuropsychi- 
atrically diagnosed psychoneurotics, schizo- 
phrenics, and brain-damaged patients. These 
were all white male veterans, aged 20 to 40, 
with unambiguous diagnoses which classified 
a patient into one and only one of the above 
three nosological groupings. The thr 
were equated for mean and stand. 
tion with regard to age, years of 
and full-scale IQ. The frequency o 
gories in each group and the 
standard deviations of full-scale IQ, age, and 
years of education are given in the report of 
the earlier investigation (2): 


ee groups 
ard devia- 
education, 
f subcate- 
means and 


Method 
Subjects. The sub 
clinical psycholo 


Procedure, 
ordered and 
individually 
pattern as 


diagnoses. 


For each psycholo 


gist contingency tables 
were set up as follo 


ws: (2) A 3x3 table 


Neuropsychiatric criterion 


z Psycho- Schizo- Brain- 

A’s diagnoses neurotic Phrenic damaged Total 
Psychoneurotic 56 39 28 123 
Schizophrenic 24 33 29 86 
Brain-damaged 20 28 43 91 

Total 100 100 100 300 


Note—x? = 20.11, df =4, p < 001, C; = 31. 
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r Neuro- 
Wechsler-Bellevue Pattern Diagnoses and Neu! 


Table 2 K 
ist 
Degree of Agreement Between Psychologis 
: in Discriminating 
psychiatric Criterion Diagnoses in Discrim 


Psychoneurotics ! 
j 
«criterion 
Psycho- l Total 
A’s diagnoses neurotic Other 123 
A z 7 7 
Psychoneurotic Sh Ei 117 
Other 


Total 100 


= 
eo 300 
200 
ans 
Note.—x? = 13.95, df = 1, p < .001,¢ = re 
over-all ‘he 
betwee? nij 


was set up to determine ce 

chance accuracy of diagnos sy 
psychologist’s Tegro and the nenta lua 
atric criterion diagnoses. This type A 
tion is illustrated for one of the pa e 10 
(A) in Table 1.° (6) To determin jago” 
chance accuracy of psychologist A sP 
with regard to each diagnostic 8 which f 
rately, 2 X 2 tables were set uP chologis | 
fected a correlation between aoe for eat 
diagnoses and the criterion — i ; 
group with the other two combin for the psy’ 
illustrates this type of correlation 08 n 
choneurotic group utilizing the the de: KS 
Psychologist A. (c) To ae crite"! i 
of relationship between pattern a signifier 
diagnoses, where chi square was twa co ki 
the corrected contingency coefficien coeflicie? 
puted for the 3 x 3 table and ae A 

for the 2 x 2 tables. 


eve. 
Jogis 
holos 


Results guat? 
t 


hi-s4' of 
Table 3 gives the results of the "i ter! Fi 
tests for the seven psychologists es e c 
chi-square values. The first colur 3 tests ad 
square values pertains to the 3 third, i y 
each psychologist. The second, ts for Pr. 
fourth columns refer to 2 x 2 ter renit vs 
choneurotics versus other, schizop! nts yer? 
sus other, and brain-damaged patie 


: je 
other, respectively. si esah s 

3 Psychologist A was selected for ne ‘ i de 
of how the chi-square tests were per ri 


d the "cal: 
the most successful performance, a him iat 
would be seriously misled if he thought ni us! ov 
On the contrary, his attempt at predicir of cê 
the inadequacy from a practical viewP° ape” 
the best performance in this group of & 
clinicians. 


Phrenics is below 


Efficacy of Pattern Analysis with Wechsler-Bellevue 


Table 3 


Chi- ee * 
hi-Square Values of Significance of Contingency Between Psychologist’s Wechsler-Bellevue Pattern 
Diagnoses and Neuropsychiatric Criterion Diagnoses 


2X2 
Psycho- Schizo- Brain- 

Psychol neurotics phrenics damaged Number 
z DEISE 3X3 vs. other vs. other vs. other “correct” 
B 20.11** 13.95** 1.38 11.38** 132 
c 21.18**t 2.11 1.98 14.52** 115 
D 8.44 36 2.33 513” 117 
E 2.41 .52 M 1.92 111 
F 6.74 .19 .01 19 107 
G 1.20 .06 1.05 07 94 

4.54 45 .03 1.47 102 


*05 > 
A p>. 
TERKO oe 


T Reflects in part some incorrectness. 
abl 5 e , 
chologist 3 immediately indicates that Psy- 
he ne s D, E, F, and G failed to agree with 
uropsychiatric criterion to an extent 


. Seat 
€r than chance expectation. This holds 


or 
ta the over-all (3 X 3) contingency as 
se or the treatment of the three groups 
pately (2 x 2) 
eae > ogist A, with 132 
Showed e = expectancy 1S 100 
rOpsychi. = ta-chance agreement wit! 
sis (p atric criterion in the over- 
Psycho 001). In addition, he disc 
aged ronie from others and br 
rom others significantly ( < 901): 
mien the reader be overly impressed by the 
igh itude of the chi-square value po i S 
i t of significance, stress shoul J e 
on on its exact meaning. It indicates tha 
€ can be quite confident that the hypothesis 
that association is false; it does not mean 
c t the degree of association is strons- : 
Ontingency coefficient for the 3 x 3 test for 
Sychologist A, corrected for the number of 
ategories, was .31. For the psychoneur' 
Vs. other and prain-damaged ys. other aa 
“ations, A’s phi coefficients were, respecti”® 7 
22 and .19. This obviously leaves much to 
be desired in the way of accuracy: | Ris 
Psychologist B’s results may be oo ine 
Ithough the over-all contingency is very Si€ 


i this large chi- 
Nificant .001) part ot 
orca, me a Setrbutable to the fact that 


i for schizo- 
the correct” diagnoses P 
number of chance expectancy- This 


s to the value of the chi 
courses detracts from the over- 


32 “correct” diag- 
correct”) 
h the neu- 
all analy- 
riminated 
ain-dam- 


The 


discrepancy a 
Square but, © 


- = 


tness of the diagnoses. This is evi- 
fact that he has a total of only 
diagnoses, which is not signifi- 


all correc 
dent from the 
115 “correct” 
cantly better than chance. 

This is a good point at which to emphasize 


the fact that chi square measures the degree 
of departure of a set of empirical frequencies 
from some hypothetical set, and does not dis- 
tinguish the direction of departure. When the 
hypothetical set of frequencies reflects the 
hypothesis of a chance association (the null 
hypothesis), departures in both directions, 
ie. both less than chance and in excess of 
chance, equally increase the chi-square value. 
It is therefore necessary, when using this 
method, to carefully scrutinize the contin- 
gency table cell by cell, before concluding 
that a significant chi square means better 
than chance prediction. 

Psychologist B does identify brain-dam- 
aged patients with above chance success 
(p < .001), but with a small degree of re- 
lationship, i.e., phi = .22. 
en ee ae with 117 “correct” diag- 

ses, 1 attain better than chance 
agreement with the criterion in the over 

e -all 
comparison. However, he, too, identifies brain- 
damaged patients with better than chance 
success ($ < .05), but with a phi ci i 
of only .13. is 


Discussion 


If the theoretical i i 

question is posed, “ 
there any detectable association oe E 
neuropsychiatric diagnostic criterion and dia : 
noses made from patterns?” the answer fare 
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be in the affirmative. If the results of the less 
ambiguous 2 X 2 tests are considered it can 
be seen that four of these are significant, 
three of them at the .001 level. This result is 
unlikely to be accounted for by chance alone. 
It is also unlikely to be a chance phenomenon 
that three of these four significant relation- 
ships occurred with regard to the brain-dam- 
aged group, or that of the seven psycholo- 
gists, three could significantly discriminate 
brain-damaged patients from Others, while 
only one succeeded with the Psychoneurotics 
and none with the schizophrenics. The con- 
clusion that some experienced Psychologists 
-Bellevue 
hance js 
e success 
ability to 


of the picture, 

f a more 
namely, “Ho: 
patterns fo 


expectancy, 
made only 132 « 


lowance is made for the 100 « 
diagnoses, then 
nonchance “correct” 


contingenc F 
31 for A’s 3 x 3 conti Sency coefficient of 
lems in interpretation, but i 


four instances of better-tha 
tion. : 
That Wechsler-Bellevue pattern 


A analysis 
cannot serve as a sufficiently valid i 


independ- 


Jacob Cohen 


ent diagnostic technique is so obvious that F 
is not worthy of comment. The data sugges 7 
however, that even as a supplementary a 
nostic aid it is of questionable value. E 
many psychologists (four out of the a 
well-qualified subjects of the present wee. 
gation), impressions derived from the pat a 
should be given no weight in the diseni ; 
decision. For some, it should play so smal 
role as to be of little consequence. 


Summary 


Seven experienced clinical psychol 1 
tempted to diagnose the Wechsler-B 5 
Patterns of 300 neuropsychiatrically honeu- 
nosed veteran male patients as psyc Using 
rotic, schizophrenic, or brain-damaged. was 
neuropsychiatric diagnoses as pelea cor- 
found that only one clinical psycholog 
rectly diagnosed a significant ce A extra- 
300 patients, and only two others ha single 
chance success in the diagnosis oe prain- 
diagnostic group (in both cases, E succes 
damaged group). The actual rate 0 ng fro 
however, ranged in correlational eee ig 
-13 to .22 and was deemed far too S 
be of use clinically. 

It is concluded that although there 
nonchance relationship between te 
Bellevue pattern and neuropsy chian intel 
nosis, it is detectable for only some a e 
and then only to so small a degree as 
little practical utility. 


Received December 16, 1954. 
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Specific Ability in IQ Change’ 
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Many ; ; 

dividu Fac have found marked in- 
Stowth ae cee in the form of the mental 
gence Tie when each individual’s intelli- 
Over a ponents or mental ages are plotted 
rapid okt of years.® Cycles of slow or 
uration pa growth covering periods of long 
Numbers PORE to be characteristic of large 
o Eene, children from preschool years to 
e tr ce. The consistency and magnitude 
Tepeate T of change in mental growth rate, 
156 y found in longitudinal studies (3, 
are Te Me 10), indicate that these changes 
the fact ue to statistical artifacts. To date, 
d ors which contribute to accelerative 
€celerative changes in mental growth 

n ih e not been clearly defined. : 
vestigate, study presented here we have m- 
ateq ria whether groups showing acceler- 
n Ne eta decelerated trends, oF little 
abilit in mental growth rate differ in their 
Bin.> t0 Pass the different types of Stanford- 
e St items. Insofar as individual items of 
‘lit tord-Binet require somewhat different 
Toy les for their solutions, differences among 
i in item difficulty provide information 
abili, OUP. differences in areas of specific 
ity. The items of the Stanford-Binet have 


à n 
Presented in part at the Annual Meeting of uae 
me i tation, New York, Sep: 
te an Psychological Association, 
Mber 1954 4 
h wledge the ma 
help Y Allthorss gra feien aaor aeey and the 
Statens SUgBestions of Dr. Jobn I a Lubing. 
a Stical assistance of MTs- Josephine } e in 
N hen one refers to maie ER ee ive: 
en 7 o! 3 
lent to nese lone Pe red of accelerative or a 
Sclerative h = jn mental growth rate. Whether 
eyes so come enor MA's is purely a mat- 
er of a to Bas tancy to be repre- 
Sehteg eae one -e or by the diagonal line 
Izy R F eA decelerative changes are de- 
7 i ccelerativ' o s se a 
Dicted relative to the Hine which is chosen to repre 
ne constancy. 


fers cons! 


often been used in this diagnostic way. Mc- 
Nemar (9) suggested that groups of certain 
items could provide rough estimates of ability 
in nonverbal, memory, and vocabulary types 
of items. 

Information regarding the group differences 
in ability to pass different types of items is 
also useful in determining the importance of 
a test-construction artifact in IQ changes over 
long periods of time. Since the Binet test in- 
cludes more so-called nonverbal or perform- 
ance type items at preschool levels and con- 
tains more verbal items at later ages, children 
with greater verbal ability could presumably 
score lower at earlier ages and higher at later 
ages as a function of the changing composition 
of the test itself, while the converse could be 
true of children whose best abilities were in 
the nonverbal area. This hypothesis has some- 
times been given to account for the incon- 
stancy of the IQ and the low predictive value 
of early tests (1, p. 294; 7, p. 643). 


Procedure 


The data for 140 children from the Fels 
Research Institute longitudinal study were 
used in the present analysis. Fifty-eight of 
the Fels subjects (Ss) admitted relatively 
early in the program received the 1916 Re- 
vised Stanford-Binet test at birthdays from 
age 3 until age 6; while 82 Ss admitted to the 
program in later years received Form L or 
Form M of the 1937 Revision at birthda: S 
and six months after birthdays from age 2i 
to age 6. From age 6 to 12 all 140 children 
received either Form L or Form M at birth. 
days. Form L and Form M were usuall: d 
sented alternately. With few exnentions Mike 
tests were administered within a few d ae 
scheduled birthdays or half-birthd ee 
were administered by one examiner ae 


307 


308 


out the testing program. The mean IQ of the 
Fels children at any age is considerably above 
average on a variety of intelligence tests, the 
mean Stanford-Binet IQ for this sample be- 
ing near 120 at all ages with standard devia- 
tions varying from 14 to 20 IQ points (10). 

In order to divide the total group into ex- 
perimental groups of those with accelerative 
changes, decelerative changes and constant 
mental growth rate trends, the following pro- 
cedure was used. A smoothed longitudinal IQ 
curve was prepared for each S by the method 
of moving averages. Prior to age 6 smoothing 
was done by obtaining the mean of blocks of 
three consecutive raw Scores when th 
terval between tests was six months, a 
blocks of two when the interval betwee 
was one year. After age 6, blocks o 
Taw scores were averaged, the inter 
tween tests being one year. The pur 


the smoothing was to eliminate errati 
tions and thereb 


e in- 
nd by 
n tests 
f three 
val be- 
pose of 
c varia- 
y effectively portray general 
trends of IQ change. The different forms of 
the test were not taken into account in aver- 
aging the raw scores. 

Quantification of the general trend in I 
change for each S was m 
way. For the Ss w 


growth rate. Group B, 
sample who ranked i 
distribution of ranks, 
showed least change; 

lected as the 25 per c 
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at 
ranked as losing in IQ. It may be pe | 
only 75 per cent of the total sample ee whit 
Approximately 13 per cent of the cas B were 
ranked between group A and group s were 
eliminated from statistical treatment £ rank- 
approximately 12 per cent of the ae were 
ing between groups B and C. These = the i 
discarded after graphic inspection handel in 
dividual IQ curves showed that ae 
mental growth rate in these two pa c than 


ranked distribution were more er other 
many of the cases falling into 
groups. 

The total sample was also sub : 
other dimension, being split into T 
groups (group I and II) of 70 ele and Í 
Poses of cross-validation in this $ Matching 
future studies of these same T vel of +7 
variables were date of birth, an S wi 
at age 3, and amount and directi complishe 
mum IQ change. Matching was = i were 
in such a way that groups A, B, D that st 
subdivided approximately equally aie groups 
tistical analysis of differences a cross-val 
Ar, By, and Cr could readily 2 
dated with groups Ay, Bu, and 2) was Ue 

A system devised by Baldwin oie jte™ 
for estimating difficulty in first aie qificul!Y 
of the Stanford-Binet, Form L. ing an i 
level for an individual in first alge itway P? 
was defined as the mental age ña the indi 
tween the mental age obtained ae on th? 
vidual at the time of his first eon of hi 
item and his mental age at the eed this 
previous failure on the same pice any ite™ 
information about the difficulty le o. est 
for each individual, it was eee eae ite™ 
mate the mean difficulty level © 


divided in a" 
o matt 


for the experimental groups. EF tests of 
Statistical analysis consisted a vel amone 
the differences in mean aah A ALA ys” 
the experimental groups. This L oot the ie 
was done for 60 items of Form d of all th 
vised Stanford-Binet, and consiste aie oug? 
items from the test level of year 
the year-XII series of items. 
Results and Discussion ang 


. am 
Seven of the 60 F tests of prone sig 
groups Ar, Br, and Cr were foun! scat aali 
nificant below the .10 level in the d-Binet: 
sis. The seven items of the Stanfor 
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F P 
differen’, which resulted in these significant 
2 and 6- S, were as follows: at year IV, items 
year V ee year IV-6, items 1, 3, and 6; at 
of Mis is. 2; and at year VI, item 5. None 
Significant erences on these same items were 
m and C upon replication with groups An; 
Were run 5 ae the second analysis 30 F tests 
est re those items which had the great- 
groups A a in mean difficulty level between 
toward oo if. and Cy. There were no trends 
ond eee icance between the first and sec- 
relative ey Since item difficulty was made 
trolled f Se mental age, and therefore con- 
Mental oy the effects of not only differential 
cludeq tages but also IQ level, it is con- 
Deere there are no differences among 
ferent t mental groups in ability to pass dif- 
results Aa of items. In view of the negative 
analyze th Form L, no attempt was made to 
For th e data from Form M. ; 
it appea experimental purpose of this study 
ferent te to make no difference whether dif- 
inet ae or one form of the Stanford- 
ine of to. used to obtain the smoothed trend 
on For Q change. Smoothed IQ curves based 
Who gd 1Q’s were prepared for those Ss 
orm received the 1937 Revision W! 
Us and Form M alternately presented- 
al of ranking the individu- 
nge from the 
i being placed 
s as before. 


in 

s = the Procedure 

ies ee to amount of cha 

in te resulted in the Ss 

Stig gy ame experimental group. ; 
Pothed curves based on Form-M IQ's only 


Yilda a 
t ‘en similar results also. A comparison © 
istributions of gains and losses was a 
3 eceived the 


ae d ri 
l9 etween those who ha 
eg Stanford-Binet during the preseh 
Re ts and those who had received the {ou 
ae \Sion throughout the testing period. The 
t S no significant differences betw 
Rai groups in the mean a 
2a or lost from the “base 
Teatest divergence. : ; 
SR emer number of a is 
ach experimental group Í bei bite 30 
Was 18, Th f the Baldwin techniq 
stimati e level resulted in loss 
den nen aimen y some items below 
the es m the anny the test. oon Ay Mi 
SANE B, with Br, and Cr 
mbined with grouP Aed design in testing 


Wi Lica’ 3 
bs for a BE number in one experi- 
ems w. 
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mental group fell below 10. This analysis re- 
sulted in no significant differences in item 


difficulty. 
Conclusions 


Within the limitations of the sample and 
methods of this study it is concluded that 
there is no evidence of differences in ability 
to pass any type of Stanford-Binet item be- 
tween those who accelerate in mental growth 
rate and those who decelerate. Accelerative or 
decelerative change in mental growth rate, at 
least in higher levels of 1Q, is apparently as- 
sociated with similar changes in growth rate É 
in more specific areas of ability. There is no 
evidence that change in the rate of mental 
growth reflects a spurious gain or loss in 
IQ due to an artifact of test construction, 
wherein the ratio of verbal to nonverbal 
abilities changes with chronological age. These 
conclusions must, of course, be limited to the 
IQ level dealt with in this study. 

Tt would appear that the factors which are 
associated with individual differences in the 
mental growth curve are more likely those 
factors which influence learning in any situa- 
tion. Sontag and his associates (10) have pre- 
sented data on the mental growth careers of 
the Fels subjects, and have proposed various 
aspects of motivation as determining factors 
in IQ change. Further research in this area 
romises to contribute knowledge of those 
factors which determine the form of the in- 
dividual’s mental growth curve. 


Summary 


The major purpose of this stud 
termine whether Ss with PR e ied ied 
in mental growth rate differed from those with 
decelerative changes in any specific areas of 
ability, as measured by the difficulty in first 
passing items of the Revised Stanford-Binet 
Scale, Form L. Matched experimental gro 
were obtained from 140 Fels Ss of aal 
very superior intelligence, who had b z 
tested at regular intervals from age 21 i 
age i Cross-validation procedure o 
alyzing 60 items. Th 
toward statistically Sgilticanih dieere ben 
Dr the groups in this analysis. R 
is concluded that at least in i 
levels of intelligence, hie with cate 
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tive changes in mental growth rate do not 
differ in any specific areas of intellectual 
ability from those with decelerative changes 
in mental growth rate. There was no evi- 
dence in this study to support a hypothesis 
that changes in Stanford-Binet IQ from the 
Preschool years to later years are due to the 
changing ratio of verbal to Nonverbal items 
in progressive age levels of the test. 
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rect "t theorie s which attempt to account di- 
Romena sodireetly for certain major phe- 
“unified human behavior subscribe to a 
ries assy Concept of personality. Such theo- 
anner me a high degree of constancy in the 
Sariin, which people perceive and respond 
Mental us situations. However, the exper 
based , Evidence on which such theories ate 
1g 1S meager and of recent origin (9, 11, 
Paper P experiment to be reported in this 
ation °y Ve hope, a contribution to the vat 
ries o of one of the basic tenets of such theo- 
tes. Personality, namely, that a person wil 
differen ìn a relatively constant anna 
this E perceptual situations. In ad ip a 
the udy offers new opportunity to exp 
Tegpg nec Pänisms or processes which uade ie 
to ay to the Rorschach method as we 
inst Ow that it can be effectively used as an 
tument for the study of perceptual proc 
es e 10, 14). soon 
is to 
Perceptual hypothesis t Dae 


Rg, 


Bateq ; 

in this experiment is 

erson p f stimuli in 
wh ne set 0 

a tus o responds to 0 lireo do 


rigid” p fe e T 

or “flexible” manne y È 
vt i While rec 
her stimuli in a similar manner- hi 


aati 
nizing the importance of aide Peat 
Stivation of behavior, We are, at P 
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time, more concerned with determining that 
there are characteristic perceptual “styles” or 
“attitudes” which remain constant from one 
situation to another. Demonstration of the 
latter is a necessary first step towaaiine 
study of motivation. s 

In this study we are specifically concerned 
with the constancy of perceptual A 
and “rigidity” from one ambiguous perceptual 
task to another. While well Sree or nE Sa 
fusion surrounding the term “rigidity,” we be- 
lieve that it comes closer to describing one 
extreme of the process we have in mind than 
other less equivocal terms. By perceptual 
rigidity we mean that the person responds in 
a relatively restrictive or selective manner to 
environmental cues, as compared to the flexi- 
ble person who responds in a less restrictive 
and selective manner to these same cues. 
Clinically, this type of person is often charac- 
terized as constricted and one who finds it 
necessary to deal with his environment in an 
unusually guarded and stereotyped manner. 

The two perceptual tools utilized in this in- 
vestigation are the Rorschach method and a 
photic stimulation experiment. In evaluating 
data from the Rorschach, Fisher’s measure of 
personality rigidity” was used (6). This 
measure is based on “. . . a variety of Ror- 
schach signs which clinically have been found 
to characterize persons who are habitually re- 
stricted and who find it necessary to deal 
with the environment with an unusual amount 
of guarded caution” (6, p. 9). We feel that 
this definition, at least in part, describes what 
we mean by perceptual rigidity. Fisher’s scale 
also has been found to be related to other 
measures of perceptual rigidity (1). 
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The second ambiguous perceptual situation 
was intermittent photic stimulation at various 
frequencies. In this experiment the subject 
was requested to report what he saw after 
stimulation at various frequencies ranging 
from 3 to 30 flashes per second. These sub- 
jective sensations were the data used in this 
study. 

In both tasks, the subject is asked to state 
what he experienced and what the stimulus 
material reminded him of or looked like, In 
both tasks the stimuli are ambiguous and 
permit a variety of responses, 


stimulation, 


Subjects and Procedure 
Subjects were 
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(4) an interview by two psychiatria a 
given, and (c) an electroencep FG Be 
(EEG) was recorded. Part of the E survey | 
cedure included a photic stimulation 140 
of 3-30 flashes per second. There ent Te- 
second exposure to each of 21 aineen 
quencies. Photic stimulation was pro ting @ 
a pendulum-type episcotister interrup 
tungsten-filament light source which : 
a 30-inch circle of light of 200 oe - 
intensity on an opal glass screen Pa visual 
rectly before the subject and filling the sub 
field. After each 40-second eapo, expeti 
ject was asked what he had me y neat! 
enced. His responses were recorde palization® 
verbatim as possible. These verl 
were the data used in this study. he first P! 
The psychological battery was th Rorschae 
cedure in the research; thus Sate stimu” 
always preceded exposure to pho Rorschat 
tion by at least a day. All the the s% 
were administered and scored by + 
Person, an intern psychologist recei 
ing at Washington University al urs! 
Medicine after having completed ine y 
requirements for the Ph.D. Sean except e 
fer scoring system (12) was bela ais whet 
scoring of form level = orig 
Hertz’ (8) scores were used. ws aidity: 
The acest of perceptual ae ra 
mentioned above, Fisher’s rigidity rigidi") 
teria © 


rojecte 
candles 


joe 
ving t? 


Schoo ; 


used as the measure of perceptual, 
manifested in the Rorschach. The cr were 4 
scoring the subjective a Í 
modification of those used by erceptt@ 
Schlesinger (10) in their study of P crite? 
attitudes toward instability. on jon® 
were developed and the subjective hai 4 
were scored independently of the ed i this 
measure of rigidity. The criteria us 

study were: 


1. Criteria for perceptually rigid group. " 
a. Little verbalization; ven E qe 
tion does not increase as flicker "Jecreasi per 
creases; verbalization may tend to of stimu 
b. Responses are detailed desc pues nts, blo“ 
©... geometric patterns or designs, lig! 
spots, circles, dots, Squares, etc. iptive ” 
c. Movement seen predominantly descrip meri 
related to stimulus, eg., whirling, shim atd 
coming and going, up and down, fu 
fades in and out, 


elabor?” 
ncy 


40- 
f 
d by 
d 
d 
di 
| 


u 
y 
h 
hi 
R Ja 
hs 
he sa’ 
hool © | 
co i 
glo 
As 
wi 
f 
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d. Uses 

s: d 
tion, Ten oe either color, form, or mo- 

responses = not able to shift or elaborate on 

creases, ven when flicker frequency in- 
+ Criteri 
é en the flexible group. 

N mid 

tends Pe cenenpen and elaboration which 
b. Responses Crease as flicker frequency increases. 
in nature ally stimulus bound nor descriptive 
j e allows self to proj k 
pa into stimulus, project forms and ob 

eme: 
predominar ee also not stimulus bound nor 
in expres ntly descriptive, allows self freedom 
tance” sion and can take attitude of “dis- 
Bones om stimulus. 

n 
type of not stereotyped, uses more than one 
Percept, allows self freedom to elabo- 


Yate 
and ŭl 3 
increases, hange responses as flicker frequency 


Sub 


Wdge, a Sensations of each subject were 
flexible É perceptually rigid or perceptually 
both authors and also were rated 
k wel they met the criteria for that 
“Cale o ratings were made on a four-point 
judgment go Adence extending from positive 
Ategory ages the subject falls into the given 
extremely > the feeling that the judgment was 
Se Pipe There was no fixed weight- 
or ure and it was rare that all the cri- 
terms One group were met. The rating was 
each = f the general over-all impression, 
Portan judge was free to determine the im- 
b ce of any one criterion. Disagreement 


ete 
hic, > the two judges as to the group m 


i 
the su Subject should be placed eliminated 
et ject from the study. A difference of 
Sct m an two points as to how well a sub- 
Ww et the criteria for the group 1" which 
Big he Placed also eliminated the subject. 
differe, Subjects were eliminated keane 
fia as to group placement, and twe E 
Ore Were eliminated because of difference o: 
tainty hee de aie met the ere 

a j e e A 

spaced the N ee to 90. The boar 
aoa o. Jeeta alone 


teria 
in 


were classified as 
ible on the basis 
photic stimu- 


Fi per cent. Pe, 
rigi ifty-six of our subjec s 
Sid and thirty-four 45 flex p 
l their subjective sensation t0 
ation, 
Results 

comparison of the ri- 

„The results of the orschach and response 


Ridity score on 
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Table 1 


Comparisons of Response to Photic Stimulation and 
Rorschach Rigidity Score 


Rorschach rigidity score 


Photic stimulation W Mean SD CR $ 
Perceptually rigid 56 33.1 11.7 r 
34 oe ine 272 000 


Perceptually flexible 


ation are presented in Table 1. 
Jearly indicate that, in this 
sample, rigidity on the Rorschach is related 
to our measure of perceptual rigidity in re- 
sponse to photic stimulation. Those subjects 
who were placed in the perceptually rigid 
group in terms of their response to photic 
stimulation had significantly higher Ror- 
schach rigidity scores. A biserial correlation 
was computed to obtain an estimate of the 
relationship between the two perceptual meas- 
ures. This correlation was .59. If a Fisher 
Rorschach Rigidity score of 25 is used as a 
cutting point, eight of the flexible subjects 
(24 per cent) would be incorrectly placed 
in the perceptually rigid group. Fourteen of 

y rigid subjects (25 per cent) 


the perceptuall 
would be incorrectly labeled as perceptually 


flexible. i ; 
On the photic stimulation task a signifi- 


cantly larger number of subjects fell into the 
perceptually rigid than into the flexible group 
(56 rigid, 34 flexible). Two explanations seem 
probable. One, our criteria was at fault. Two, 
the larger number of perceptually rigid sub- 
jects was a function of the photic stimulation 
task. Both probably are factors. Our criteria 
were a -first attempt at such discrimination 
and refinement is undoubtedly possible. How- 
ever, the most important factor seems to have 
been the general conditions under which our 
sample was subjected to the photic stimula- 
tion task. 

For most of these subjects it was their first 
trip to a neuropsychiatric hospital where the 
laboratory is located, and it probably was dis- 
concerting to have several needle electrode: 
stuck into one’s scalp for the first time There 
was no structuring as to what would ha 
to them or what they should see duri eels 
stimulation. Thus it is n odie ranio 

ot surprising that 


to photic stimul 
These results C: 
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many of the subjects were apprehensive, and 
reluctant and guarded about expressing them- 
selves. Those able to express themselves freely 
are, perhaps, individuals who are able to 
adapt themselves to new and ambiguous 
situations, 

The Rorschach, on the other hand, was ad- 
ministered in a more familiar situation—at 
the seminary attended by these students. The 
rigidity scores on the Rorschach were nor- 
mally distributed, and the scores for both our 


Comparison o f 


Individual Rorschach Vari- 
ables 


Table 2 


Comparison of Individual Rorschach Variables 


Mean scores 


Rorschach perceptually Chi 
variable Flexible Rigid square p Cc 
R 48.3 34.5 11,53 -001 34 
#M 
(uncorrected 
for R) 462 2.28 20.79 -001 44 
#M 
(corrected 
for R) 7.69 -008 -28 
#0 
(uncorrected 
for R) 10.2 6.1 10.76 -001 -33 
#0 
(corrected 
for R) 027 NS E 
T/R 36.1 53.9 17.80 -001 -41 
T/IR 18:5 27:6 8.30 .006 -29 
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responses than the perceptually rigid grou 
the chi squares for number of mo me 
(#M) and number of original Mee: 
(#0) are reported with and without : 
tions for R. The method of correc ae 
that suggested by Cronbach (3, Bi “ed, chi 
most of the distributions were i“ Pie 
Square measures of sei “a groups 
puted. The median of the combine tingen 
was used as the dividing point. A ee 
Coefficient was computed to ae = the 
of the degree of association ange. jon 
groups for each variable. These co pro ct 
of course, are not comparable he the 
moment correlations and are limite does 
number of categories, but their use linearity’ 
include assumptions of normality ee which 
Of the 17 Rorschach —. signi 
chi squares were computed, five Ny dicated " 
cant beyond the .01 level as in ad unco” 
Table 2 (#R, #M corrected a R rh 
tected for R, #0 uncorrected Onde ph 
T/1R). Those not significant nE Sum o 
Dgo St, Fle, #FC, #CF + | variety % 
#0 corrected for R, #P, P% an was 2? 
content. As O when corrected i of orig 
significant, the difference in numi E t 
nal and variety of content respons i 
be a function of difference in R. castrés 
These findings relate well o ea evalu 
personality rigidity used in the clini Ai n 
tion of the Rorschach. Most Rora A Ye 
perts would agree that restriction yl ate 
of responses, few movement resp veactiOd n p 
time per response and delayed rea minati” 
are major signs utilized in the ae of 0 ig 
of personality rigidity. The numbe an ind 
nal responses is also often used a flesiP a 
cator of rigidity, and even though ste a th? 
groups gave significantly more orig hen cor 
difference failed to be significant W „A 
rected for R. to be a 
The failure of F% and F + 9 to Pe sy i; 
nificantly different in the two pan nes e 
prising. F + % approached sige t} 
-09, and was in the expected ee , i 
light of the common use of F% an idity, ™ 
as indicators of constriction and rigi 
expected the difference to be larger- 3, 3, 
Because of the differing reports (3, tjo 
on the relationship of 3 to R, a corre: A «of? 
scattergram was plotted and as the re 
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Cras Table 3 
arı i 
ne a Groups Using a Plus or Minus Scoring 
ie and Comparison of Individual 
ementsin the Fisher Scale 


Per cent plus scores 


“vidual perceptually 
= ts Flexible Rigid CR $ 
A ‘Ments 33.9 43.2 2.67 .008 
P 41.1 46.4 49 i 
4% 3.0 196 2.26 .02* 
Pop 8.8 5.4 51 ma. 
Colo 35.3 554 1.66 06 
w 52.9 57.1 39 = 
Da 23.5 33.9 1.05 = 
i 38.2 42.9 48 am 
Content 17.6 51.8 3.23 001 
TR 765 64.3 1.22 = 
aN 23.5 é 2 am 
#R Hra es Ponses 52.9 i25 “0 0001 


P+M 186 423 416 | 


Nee 
Te 
ected for Continuity. 


Ship p 


et 
Produ, Ween M and R was linear, a Pearson 


e B aia correlation was computed. 
x A was .50. The correlation be- 
83, q and #R, similarly computed, was 
Sitare 1s thus not surprising that our Chl 
20.79 g value for 3 should decrease from 
a i 7.69, and from 10.76 to .027 for 

oe for R. These findings len 
Man ( to the findings of Fiske and Baugh- 
tolling 224 indicate the importance of con- 
determi; when using individual Rorschach 

Mants for comparative purposes- 


Nala os 
fi of Elements in Fisher’s Rorschach 
Cale 
ual Rorschach 
data suggested 
orschach scale 


tal score, 
Ror- 


T 
varia analysis of the individ 
thag „°S and inspection of the 
arg © elements in Fisher’s R 
ang Ot contributing equally to the to f 
sp, that a differentiating measure 


hach PPE a 
A ig py utilizing 
Simp] rigidity was possib ee procedure. In 


thel® plus or minus scot sig 
sil ponds, a NEN cnet 1 
c ca penalty ater The larger 

“Xcess rigidi aibetric ven > 
ae final ae of weights, Trg tal 2 
in, implied rigidity. 1 this presen mi 
Ns ead pees oe weighted score, only a 
Of assia enalty score was indi- 
hen 4 P! score was indicated, 
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a £d. When no pete individual elements 
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of the Fisher scale were similarly analyzed 
with the exception of card turning which was 
not scored because of incompleteness of data. 
The percentage of plus signs for each group, 
and the differences are given in Table 3. 

As expected, the over-all difference between 
the two groups is highly significant. Those 
classified as perceptually rigid on the basis of 
their response to photic stimulation have a 
significantly larger percentage of plus scores 
than do those labeled perceptually flexible. 
The results of the analysis of individual ele- 
ments are consistent with those found in the 
comparison of individual Rorschach variables. 
Human movement and number of responses 
were significant beyond the .05 level, and 
F+% at the .06 level. While the other 
scores were not significantly different, the 
differences were in the expected direction 
with the exception of A% and content. The 
use of only #2, F + % and M in future re- 
search of this kind is suggested by the highly 
significant difference obtained when only these 
three elements are used for comparison. 
Relation of Perceptual Rigidity—Flexibility 

to Intelligence and Anxiety Proneness 

The results on the Rorschach suggest that 
the perceptually flexible group is possibly 
more intelligent than the perceptually rigid 
one, raising the possibility that the life styles 
in question are simply those of more or less 
intelligent students. To evaluate this possi- 
pility two measures of intelligence were uti- 
lized for comparison, ACE scores and a short 
form of the Wechsler-Bellevue (Comprehen- 
sion, Vocabulary and Similarities). The two 
groups did not differ significantly on either 
the group or individual test. The mean ACE 
score for the rigid group was 132.8 and 135.8 
for the flexible group. The mean CVS scores 
were 41.7 and 42.4 for the rigid and flexible 
groups, respectively. Thus the possibility that 
the style of behavior exhibited in these two 
perceptual situations is a function of intelli- 
E 5 not as 
_ As the psychological tests and iatri 
interviews of which these data are 5 P 
used extensively to judge anxiety proneness 
a comparison between the anxiety-pronene: : 
score and our measures of rigidity-flexibi 9 
was possible. Thi Bicity AeMbity 

- This seemed to be particularly 
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relevant since Ulett (16) has found this meas- 
ure of anxiety proneness to be related to feel- 
ings of dysphoria during photic stimulation 
and since there are some who think of per- 
sult of anxiety or a de- 


(4). 


A ` results 
seem increasingly relevant to the above for. 
mulation. They state: “It seems a worth- 


Laverne C. Johnson and John A. Stern 


cts of pe 
while hypothesis that those aspe theo 


ic theo! 
. 7 tic 
ceptual process which peyton themsel¥™ 


Je, 16 
i 


, 
currently view as bese par He 
idiosyncratically organized wi anil 
into ‘styles of autonomous func wit 
Di oye Gray" 

A third alternative suggested by hibited 


À havior ex a 
ter’s work (17) is that the ee oy af 
Í 


is a resultant of physiologica functo 


determined rather than pee i 
anxiety. He has reported t re 

a particularly vivid illusion „receded 0 f 
during photic stimulation w alteratio? f 
companied by a characteristi ‘tal tio 
the electrical response of the pei usually “is 
and autonomic disturbances be a O21 oe 
related with augmented res por poral ref A 
per second from the parien g: G'E 
The use of electronically Pa may Ey 
ords during photic stimat subjecti? 
indicating the association 0 e in the 
sations to electrical cael ai relation j 
even though no cause-and-e Further W 
can be inferred at this time. 

in progress in this area. 
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Summary and Conclus! 


ew OV eff 

The results of this study Er aen 4 oy? 
to the growing belief that th ttitudes” *, ht 
tual styles” or “perceptual ond a ha 
are consistent modes of response, 
Rorschach method can be meg 
a perceptual instrument in t individu? 
sonality. We have shown that J mannet 
respond in a perceptually ae a like 
perceptual task will respond nation. 
to a different perceptual situ a 
factor which both tasks have tual situ” gy 
that they are ambiguous a oe indir {0 
The hypothesis was proposed tent manne g 
respond in a relatively consis E 
environmental cues, and two pe urthe! 
were utilized to test this. we i co 
pothesized that the Rorschach of perce? 
be used as a tool for the study “oda 
and that Rorschach repan in kind 
adaptive processes not differen ceptually W 
those appearing in other Parpol 
biguous situations. To test the meee 
utilized data collected on 117 ese 
dents from a local seminary. = their 
were given the Rorschach, ani 


A of? 


Rorschach Rigidity and Response to Photic Stimulation 


ioe during intermittent photic 
sations a were recorded. The subjective sen- 
schach nt used for comparison with Ror- 
The Pie 
cording ri were scored for rigidity ac- 
e subj ye technique developed by Fisher. 
Signe on sensations were scored inde- 
dividing che ete an a priori criterion for 
tually rigi e sample into two groups, percep- 
6 gid and perceptually flexible. 
cantly Cony flexible group had signifi- 
did the wer Rorschach rigidity scores than 
dividual te eptually rigid group. When the in- 
amined, th orschach determinants were €x- 
found to “i perceptually flexible group was 
SPonses, m, ave given significantly more re- 
time per Ore movement responses, taken less 
Ower ay, response, and had a significantly 
ndings erage reaction time. In contrast to 
id. nie reported to date, F% and F + % 
8toups Se ifcintly differentiate the two 
exibilit either of the two perceptual rigidity- 
sca y measures was related to intelligence- 
Tes or to a measure of anxiety prone 
» The significance of these findings is dis- 
and alternative hypotheses are sus 
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Books 


Allport, G. W. Becoming: basic considerations for a 
psychology of personality. New Haven, Conn.: 
Yale Univer. Press, 1955. Pp. ix + 106. $2.75. 


Revised from Yale’s Terry Lectures, which chal- 
lenge the lecturer to relate his specialty to human 
welfare and to a broad conception of religion, this 
little book is a quietly bold attempt to present a 
perspective in psychology on such matters as free- 
dom, the religious sentiments, and the democratic 
ideal. The unifying concept is that of personality, 
taken as something continuously becoming rather 
than ever meaningfully identifiable on cross-sectional 
analysis. Personal uniqueness, selfhood, and auton- 
omy, familiar Allportian principles, play their pre- 
dictable roles in the emphasis on the person as the 
growing and evolving unit of psychological interest. 
Finally, psychology’s prime task is conceived as that 
of determining whether “the democratic ideal is 
viable.” Read as an impressively learned and even 
Poetically sensitive statement of a possible relation- 
ship between psychological science and certain vital 
human values, Becoming provides a Profiable ex- 
perience for any psychologist concerned about either 
his discipline or his status as an intellectual in the 
tepublic’s citizenry, Similarly, Allport’s insistence on 
the process character of Personality is useful and 
welcome. One may wonder, however, if such bor- 
Towings as Swedenborg’s concept of the proprium is 


not evidence for a flirting with reification in the 
ideas of personalit: 


analysis and neo! 
only as convenient but 


oes other than inhibit 
for which he argues 


BJS. ultivated persuasion — 


Arieti, Silvano. Interpretation o 


Í schizophrenia, N 
York: Robert Brunner, 1955. Pp. xxiii + 522, $6.75. 


In spite of the author’s modest disclaimers, Inter- 
pretation of Schizophrenia is a thorough, systematic 
treatment, and about as complete as a single volume 


Note—The reviews were prepared by the Editor 
and the Advisory Editors, who may be identified by 
their initials. 


rieti 
on so vast a subject can be expected to lig; De i 
proceeds logically from a historical deve m BES 
psychodynamics, through a study of form re 
nisms in schizophrenia, to discussions 0 Aven a 
stages of the disease, the organic manifes sie : oe 
methods of treatment. The point of vic "ic Sa 
namic without an underestimation of se “sa 
tors. Of special interest to psychologii Retreat 
ters on “The Retreat from Emotions, — i 
of Reason,” and “The Retreat from Sanity, 
out only three of the twenty-four excellent 
The book is well-written and reads eak f 
cussions are few but rather full, although - p 
behavior samples abound; a bibliograp ‘4 work # 
titles is listed. It is an important roteren d 
well as a balanced text on schizophrenia- 


, Fieldsteeh 
Blum, Lucille H., Davidson, Helen H, brie Io- 
Nina D. A Rorschach workbook, New 166 (PY 
ternational Universities Press, 1954. Pp. 
per). $2.00. -atrod 
This lithographed paper-bound volume ig 
the student to each of Klopfer’s major are 
terminants and provides an extensive Peter e 
ing exercises for each. The “correct i chapter > 
provided in an Appendix. A brief final ttentio® to 
devoted to administration with special pr curat? 
the inquiry as an essential prerequisite es are COF, 
scoring. Neither the text nor the Lins Fi or? 
cerned with interpretation, which in t of ski 5 
opinion should follow the developmen coring” h 
scoring. The “basic bibliography On 5 
seven titles—E. L. K. 


uces 
de- 
or" 


wW 

s aang t. NO 

Patrick, Catharine. What is creative Ha 421 
York: Philosophical Library, 1955. PP- 


p 
$3.00. ‘cations of 
This is an amalgam of well-known Hee f: A 

creative thinking, with selected materia 


ing. Included also are a chapter on age nge thi” 
tivity and a program for improving eae 
ing. The quotations and data are organa og, an 
stages of preparation, incubation, illumi mprehen®! 
revision or verification. There is a C° 
bibliography. —A. R. menið 
Rose, Arnold M. (Ed.) Mental health an No 
disorder, a sociological approach. New # 
ton, 1955. Pp. xiv + 626. $6.50. eries to pe 
This volume is the first of a projected 5 for 
published under the auspices of the Sock j 
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New Books and Tests 


a SE Sanal Problems, an interdisciplinary group 
ann ava with the integration of sociological, psy- 
iting and anthropological research and the ap- 

ia of these researches to human problems. It 
Btiidies a collection of thirty-eight essays, case 
the (Seg reports, and systematic analyses of 
rather > ure, planned to give an overview of the 
a ec tered materials in the field. Ten of the 
Others eee prepared especially for the volume; the 
logical ee appeared previously, chiefly in socio- 
E Broups, + igs The papers are presented in seven 
Problems e titles of which indicate the wide scope: 

A of social psychiatry and theoretical over- 

ieee pan characteristics of the mentally disor- 

EN ore disorder in the community, sociologi- 

social to the study of specific disorders, 

ory of personality organization and 
lems Sera the sociological approach to prob- 
to the ep to mental disorder, and contributions 
may be Ee ading of mental health. The survey 
considerable a to psychologists. It concentrates a 
ost of te amount of data and discussion, and 
Wp e papers have extensive bibliographies— 


Roye 
X eng E. Personality and mental health. 
$3.50, ukee, Wis.: Bruce, 1955. Pp. xiv + 352. 


This þri 
Scho) brief survey of modern clinical psychology is 


with “aie in viewpoint and “integrated throughout 
author idy Christian philosophy of life.” The 
the Shee his basic text in mental hygiene and 
Problems FH of adjustment with reference to the 

inclu de students. He therefore did not attempt 
‘Atious a; references on all the material or on the 
ti reas, but gave emphasis to classroom situa- 


ions 
and students’ needs—B. M. L. 


Uke 
tt, G 
erly Se Rorschach introductory manual. Bev- 


1955, iy Calif.: Western Psychological Services, 
seg 45 (Paper). $3.50. 
z in ae second edition of a manual first pub- 
in ique a as an aid in teaching the Rorschach 
S Braphed Physicians. It is an attractively printed 
abe ratio booklet, covering the essentials of ad- 
50 are a Scoring, and interpretation. Included 
multicolored «tee calculation table, an ingenious 
Bess Interpretation Chart,” and a table of 
Wen © ten in clinical diagnosis. The approach is 
“id. the text, while didactic, is extremely 
atchach, first sentence in the text states: “The 
on Bae is a remarkably accurate means of 
autho ater mation about a patient's personality 
an, hor ee in the chapter on interpretation, the 
) sti i at, that “some of the Rorschach theory 
OBR” 7 tation given in the following pages are 
$ of © question.” There is a selected bibli- 
61 titles —E. L. K. 
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$ Tests 


Holzinger, Karl J., & Crowder, Norman A. Hol- 
singer-Crowder Uni-Factor Tests. Grades 7-12. 
2 forms. 40% (90) min. IBM or hand scoring. 
Test booklets ($5.70 per 35) with manual, pp. 30; 
2 answer sheets ($1.80 per 35, and $1.15 per 35) 
keys (50¢); specimen set (50¢). Yonkers, N. Y.: 
World Book Co., 1955. 

The Uni-Factor Tests consist of nine subtests which 
measure four factors: verbal, spatial, numerical, and 
reasoning. Each factor is scored separately, and in- 
terpreted by the aid of percentile tables which give 
norms for each grade from 7 to 12. In addition, a 
Scholastic Aptitude Score may be obtained from a 
simple regression equation which combines the 
verbal, numerical, and reasoning factor scores. Al- 
ternate-form and split-half reliabilities for the sepa- 
rate factors compare favorably with other similar in- 
struments. Typical jntercorrelations among the fac- 
tors, for single-grade groups, range from about 30 
to about .50, and show that the scores, while not 
independent, possess considerable distinctiveness. The 
Manual contains unusually full data on the relation- 
ships of the factors to other concurrent measures— 
other intelligence tests, achievement tests, and school 
marks. In these data, differential values of the fac- 
tors are evident. Although the ultimate merit of the 
test in predicting academic and vocational criteria 
remains to be determined, it represents one more 
thoughtfully constructed tool for analyzing “global 
intelligence” into some meaningful parts—L. F. S. 


Wechsler Adult Intelligence Scale 
6 and above. Individual test. 1 
th 25 record forms, and 


manual, pp. vit 110 ($21.00) ; record form only 
($1.60 per 25); manual only ($2.75). New York: 
Psychological Corp., 1955. 
The long-awaited revision of the Wechsler scale 
will fulfill the demands of psychologists—it is enough 
of a revision to remedy the major shortcomings of 
the 1939 Wechsler-Bellevue, and not so sweeping a 
change as to discard the experience gained by cli- 
nicians from the use of the older test. The eleven 
subtests remain the same, but all except the Digit 


Span have been revised in some degree. The Vo- 
cabulary subtest is wholly new; onb Pio and 

d items have been remove rom Informa- 
gia and Arithmetic, and the Ob- 


i ‘omprehension, l 
wy E has been lengthened by adding an- 
other object, an elephant. The major standardization 
from ages 16 to 64 was based on 1,700 examinees 
with equal numbers of men and women, and with a 
precise stratification of geographical region, urban- 
rural residence, race, and occupation based on the 
1950 census. The manual contains appropriate data 
on reliabilities and subtest intercorrelations for three 
age segments. Corrected split-half reliabilities are .97 
for the full scale and range from .66 to .96 for the 
subtests. The manual and record blank both warn 
against making clinical interpretations from profiles 


Wechsler, David. 
(WAIS). Ages 1 
form. Test material, wil 
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or from differences between subtest scores with lim- 
ited reliability. Left for future research, perhaps 
quite properly, are the relationships between the old 
and new scales, and the validities of the revised test 
for various applications. The test itself and the data 
in the manual give the impression that the WAIS is 
a mature and sophisticated instrument, a worthy 
successor to the Wechsler-Bellevue for both clinical 
service and research—L. F. S. 


Wittenborn, J. Richard. Wittenborn Psychiatric Rat- 
ing Scales. Psychiatric patients. Individual rating 
scale. 1 form. Rating scales ($2.75 per 25); with 


manual, pp. 12; specimen set (35¢). New York: 
Psychological Corp., 1955. 


A series of 18 research articles since 1950 has re- 
ported the development and application of the Wit- 
tenborn scales. Now they are made available for gen- 
eral use in an attractive and convenient format. The 
scales are an aid to the objective description of psy- 
chiatric patients in terms of their observable symp- 
toms. On each of 52 areas of behavior, a patient is 
rated by selecting the one of four statements which 
describes him best. The quantified ratings are turned 
into scores on nine factors identified by factor ana- 
lytic studies, The corrected split-half reliabilities of 
the factor scores range from .67 to .92, with only 
one scale below .76; their intercorrelations are gen- 
erally low. The new blank greatly simplifies the 
calculation of the factor scores by reducing it to the 
addition of digits in conveniently arranged columns 
and the use of a simple table. With their new con- 
venience and availability, the scales will probably 
receive wider use in research. They make a valuable 
contribution to the knottiest problem in studies of 
pae a the problem of the criterion— 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 


first or second issue to go to press following 
their final acceptance. 
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Comparison of Visual, Content, and Auditory 
Cues in Interviewing" 


F. Harold Giedt* 
VA Hospital, Sepulveda, California 


_ Despite the wide use and importance of the 
Mterview as a method of judging personality, 
It still remains largely an artistic technique 
tather than a scientific tool. Because of con- 
Siderable “faith validity” and more modest 
empirical validity, the interview is most prob- 
ably here to stay, Consequently, the best re- 
Search approach would seem to be to deter- 
mine in what way accurate or inaccurate in- 
mation is obtained through interviewing, 
"ather than to try to prove merely whether or 
Not it works, 

This study was designed, among other 
things, to determine which of the several 
forms of observations available to the clinician 
” the interview situation seems most related 
«Making accurate judgments of a patient. 
80 © plan was to control experimentally the 
i ats of observations available to the evaluat- 
2 clinician by means of interviews recorded 
Co Sound film, By this procedure the clinician 
ae be presented with (a) visual cues (silent 
ae (b) verbal content (verbatim atten 

Script content plus auditory 

(Sound ta (d) espa plus auditory 
Ad visual cues (complete sound film). 


tra, 


Procedure 
siemens : $ 
Interviews, Two clinicians interviewed fou 


atients, producing eight separate ha a 
ich were recorded on sound film. Two 1 


ret it 
varom the Veterans Administration Hospi 
cl 


al, Long 


issertation 
i ision of a doctoral disser! 
ig tere, reve» Department of Psychology, 


ae dames ae for their aid and encouragement. 
. Sew: 
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terviewers, a psychologist and a psychiatrist, 
were used to provide two different approaches 
to interviewing. Each interviewer was in- 
structed at least to touch on the patient’s 
home adjustment, work adjustment, educa- 
tional achievement, and his present illness. 
Both were also acquainted with the person- 
ality dimensions that were later to be rated 
on the basis of the recorded interviews. 

Four male patients were used in this study 
to provide some representation, albeit limited, 
of divergent personalities and modes of ad- 
justment or maladjustment. Three moderately 
disturbed, voluntarily hospitalized, neuropsy- 
chiatric patients and one general medical pa- 
tient were chosen. A brief description of each 
patient follows: 


Patient A was a young veteran diagnosed schizo- 
phrenic reaction, paranoid type, moderate. 

Patient B, a middle-aged man, was hospitalized 
for ulcer-like symptoms but later was diagnosed as 
having gastritis and a hypertrophic body in the 
antrum of the stomach. He represented a pleasant, 
near normal subject. 

Patient C was a young veteran diagnosed anxiety 
reaction, acute, with marked tension, irritability, 
mild depression, and battle dreams, i 

Patient D was a middle-aged man 
hospitalized for alcoholic gastritis al 
ulcer, but was later diagnosed as schi: 
tion, unclassified, with a depressiv: 
chronic alcoholism. 


who was first 
nd a possible 
zophrenic reac- 
e reaction and 


The interviews were all filmed in one after- 
noon. They were conducted in an office with 
a one-way mirror. Camera, sound equipment 
and technical personnel were located in an 
adjacent room out of sight of the patients 
There were about twenty minutes for the 2a 
tient to become accustomed to the lights an 
microphone equipment and for the interviewe 
to develop some rapport with the patient ba 
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fore the formal interview lasting twelve min- 
utes began. It was the consensus of opinion 
of those involved that all the patients re- 
sponded well to the interviews and did not 
appear to be particularly defensive, embar- 
rassed, or exhibitionistic, 

Evaluation measures. Given some sample 
of a person’s behavior as it occurs in an inter- 
view, there are a number of Possible judg- 
ments or conclusions that could be made 
about that person. In actual 
cians describe a 
his behavior, an 


his treatment or disposition. Such end prod- 
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Analysis of these reported cues will be te 
ported in a later paper. ae 
For most of the personality characteristics 
that clinicians are called upon to eval 
(except intelligence), there are no stant 
ardized tests that are widely accepted B 
criteria. The best available criterion in 
case seemed to be agreement among dges 
persons considered the best available JY že 
of the personalities of the four patients. hos- 
judge was the chief psychiatrist at the wert 
pital where all the patients considered <j 
then under treatment. This psychiatrist i i 
also one of the two interviewers in ee was 
Another judge was the psychologist vi made 
the other interviewer in the study. Be lovin 
the Personality ratings immediately R o 
each interview with the four patien rat 
other psychologists contributed criteria ne 
ings on the basis of testing the Pat vechsle 
administered the Rorschach and u ot 
Bellevue test to all four patients. va the 
gave the Thematic Apperception Tes : ad 
Draw-A-Person test. The experimente t 
another set of ratings. ued 
The criterion, as well as all subs ues 
ratings, were translated into numerica Ee af 
ranging from zero to nine. The n si ydid 
criterion ratings were then statistica v3 ov? 
by simple analysis of variance. This fe et 
to determine whether the differences ant 
mean ratings of patients were sig? ance 
more than might be expected on n amore 
basis, as determined from difference A jent 
the criterion judges’ ratings of single Fe coul 
It was felt that only if such agreeme the a 
be demonstrated could the average © nsidet 
judges’ ratings on one patient be eae ratio 
stable enough to be used as a eae. cter 
Only five of the rated personality Er (p o 
istics showed considerable agree ae K 
.001) among the judges’ ratings for ea ee 
tient and one more showed fairly ce a 
ment (pf of .02). In addition to ite ot 
criterion ratings the Wechsler-Bellev o o 
IQ scores were used as the erite e seve 
ratings of Intelligence. Table 1 lists crit 
characteristics for which acceptable 5 
were established and gives the numeric: 
of the ratings for each patient as We meri 
meaning of the rating at the lowest n" 
value. 


five 


Visual, Content, and Auditory Cues in Interviewing 


409 


Anxiety 


Table 1 
Numerical Values of Criterion Ratings for Each Patient 
Patients 
Meaning of low numerical 
Personality characteristics A E E D values 
Intelligence 3 6 4 2 Very superior 
3 5 di. 2 Overwhelmed with anxiety 
pendency-Independency 5 7 2 3 Wholly dependent on others 
„erence to Reality 7 4 6 6 3 Psychotic disregard 
Irection of Feelings towards Others 6 5 5 fj Very warm feelings 
Frontaneity 4 6 6 2 Wildly impulsive 
lexibility of Adjustive Techniques vj 4 7 7 Tries anything that works 


tite patient sentence completions. In 
of control as in Luft’s study (4), the method 
a second led cross-predictions was selected as 
Others mee of effectiveness in judging 
Cian’s | ‘his method of determining a clini- 
E ability to predict a patient’s responses 
advan ended incomplete sentences has the 
Opporiees of providing the clinician with an 
havior y to predict the patient’s actual be- 
and Be a very specific, known situation, 
Serve”. having the patient’s own responses 
s aa the criteria, Its chief disadvantage 
is Dr "ticism may be that the behavior which 
routed has little practical significance. 
in une the assumption is that differences 
ftom “ity to predict less crucial but still far 
Simple behavior, such as a patient's 
a. to a test item, would reveal different 
Pecifi of understanding of that patient. 
Pedic the method of controlled ae 
clinici lons as used in this study required the 
ona to select out of four choices the re- 
comple de felt a particular patient gave in 
Choice ting an incomplete sentence. The g 
the p> Were the actual responses given oy 
An os Patients interviewed in peo 
follows Ple of one such prediction situ 


te ; 
sr 1: Most of all I want (stimulus portion of the 

~to nce) 

Sbeas ceed (patient C’s response) - 


~i ce of mi ient D’s response). r 
we and "a sepa 188kiDg wife (patient A’s re- 


800d job (patient B’s response) - 

ty-five incomplete 
linicians had to 
by the par- 


tenn here were a total of thir 
Sele ‘Nees for which the cl 
the actual responses given 


ticular patient under consideration and the 
number of correct predictions constituted his 
accuracy of prediction score. This measure 
had a split-half reliability of .60 with the 
Spearman-Brown Correction. 

Presenting the interview material. A num- 
ber of factors had to be considered in design- 
ing the exact manner in which the interviews 
were to be presented. There were (a) the 
four modes of presenting the interview mate- 
rial, (b) the four patients to be judged, (c) 
the two interviews with each patient, and ( d) 
the order in which any condition was pre- 
sented. In order to study the effects these 
various independent variables had upon the 
dependent variables, the two measures of 
accuracy in making personality judgments, 
a modified greco-latin square design was em- 
ployed. All factors were varied and controlled 
so that no condition had any priority in the 


Table 2 


Design for Presenting Interview Material 


Order of presentation 


Evaluating 

clinicians 1 2 3 4 
Group I Aal Bb1 c2 
Group IT He “Adi DA a 
Group TIT Cd1 De2 Ab1 Ba2 
Group IV Db2 Ca2 Bd1 Aci 
Group V Aa2 Bb2 Cel Da 
Group VI Bel Ad2 Dal Q 3 
Group VII Cd2 Del Ab2 3a 
Group VIII Db1 Cal Ba2 ae 


Note.—Capital letters (A, B 
2 +, CD 
tienta. Small letters (a, b, ¢, d) rimant e 
p ene ee material. Numbers (1 i 
e tw viewers. Each grou poset 
chiatrists, two social workers, and two payee 


the four pa- 
ur modes of 
2) represent 
ka two psy- 
S. 
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order of presentation and no combination of 
conditions was favored, as can be seen in 
Table 2. 

The evaluating clinicians. A most important 
group of participants in this study were the 
psychiatrists, social workers, and psycholo- 
gists, who graciously volunteered to observe 
the different sorts of interview material and 
then attempted to evaluate the patients who 
were interviewed. Altogether there were forty- 
eight such evaluating clinicians, with sixteen 
from each of the three specialties. Each group 
indicated in Table 2 was composed of a pair 
from each of the three professional groups 
with one of the pair being an experienced 
clinician and the other someone in training. 


Results 


Personality ratings. Each clinician’s rating 
of a particular patient on a particular trait 
was compared to the criterion rating for that 
patient and trait, and the amount of devia- 
tion determined. A total deviation or rating- 
error score for each clinician’s set of ratings 
on each patient was obtained by summing the 
deviations from the criterion ratings for the 
seven personality dimensions. To insure that 
the deviations for all seven dimensions would 
contribute equal weight to the total rating- 
error score, the variances of the seven dis- 
tributions of deviations were equated, and 
where necessary, the deviations were mul- 
tiplied by a constant before they were summed 
to form the total rating-error score. A low 
score indicates an accurate series of ratings. 

In order to get an idea of the statistical 
and psychological meaning of this total error 
score, the intercorrelations between the seven 
distributions of deviations from the criterion 
ratings were determined. The average correla- 
tion was .03 with only two positive and one 
negative coefficients of the twenty-one inter- 
correlations significantly above zero at the one 
per cent level. This finding suggested two 
possible explanations. The different ratings 
are in fact quite unrelated, and one would not 
expect accuracy in judging one trait to carry 
over to another trait. The other possibility 
was that the trait ratings are very unreliable 
measures and deviation, from or approxima- 


tion of the criterion is governed largely by 
chance. ro, 
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To determine which of these explanation’ 
the more applicable the —— ae 
tween the actual ratings, ee ee 
criterion ratings, were found for o een 
rating scales. The average arp nie 
was only .16. Eleven positive and tw icine 
tive 7’s of the matrix of twenty-one be Fra 
relations were significantly larger ations 
at the one per cent level. These pai n 
suggest that the actual trait rati B inde- 
aside from some halo effect, relativ Se first 
pendent ratings and lend support a repe? 
explanation. Although no measure i, anah 
reliability of the ratings was. on ‘ 
proximation can be obtained in t j 
relation of the scales, Direction p 
towards Others and Social Impresso ah i 
was .60. One scale was designed ef 
the patient’s general friendliness po pati 
the judges’ friendliness towards os 
dimensions which are probably V! 
related. Thus it would seem ma 
reliability would be greater t ge: k 
interjudge reliability ranges fro 2 of ag 
.55 to .68 indicating a fair degre me 
ment between the judges in their is oa 

It therefore seems reasonable ratings 7 
there is sufficient reliability in the ate y 
independence in the scale dimen # f 
combining the separate deviation score My 
criterion ratings into a total erro ater’s JY 
measure of the accuracy af each T j 
ment of a particular patient. one 

When = data were tabulated, r we 
moderately significant over-all di 4 ting 
found to exist between the accuracy rviem 
based on interviews conducted by, A f 

iatri Interview® ance 
No. 1 (psychiatrist) and In ave di ere! k 
(psychologist). However, object! inter ew 
in the way in which the ae e pati 
operated and their effects e py Bu en 
responses has been demonstrate ie 0 
(1) using the written protoco 
study. 


-erore 
diffe" 
Since there was no demonstrable 


to diffe 


; t simplify $ pal’ 
interviewers, and in order to all the 
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imposing the bottom half of Table 2 on the 
top half, 

Analysis of variance. Data derived from 
the four effects or variables listed below were 
analyzed: 


l. Order in which a patient was observed 
and rated. 

2. Sequence or pattern in which different 
oe and modes of presenting the inter- 
lew Were observed and rated. This effect 
tome any differences between the four 

med groups of clinicians as each group 


foll 
i One of the four sequences of presenta- 


3, ; 3 
4 atien being observed and rated. 
tial, Ode of presenting the interview mate- 


of ho Table 3 it is apparent that the factor 
effect Patient being rated had the greatest 
and $ the accuracy of the ratings. Patients 
have mos who were most accurately judged, 
the th Ost of their criterion ratings at or near 
umpe ctical mean and have the largest 
the s er of ratings on the favorable ends of 
cales, 
S mode of presenting the interview ma- 
e ac appears to have some influence over 
statisti of the ratings. Actually, the only 
bett ically reliable differences (p of .05 or 
tWeen between the different modes are be- 
Mode the silent film and the other three 
Com S and between the written protocols and 
Plete sound film. 
ere was a significant order or practice 
» ìn that a clinician’s ratings tended to 
®ve in accuracy from the first to the 


fect 
pr 
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third time he filled out the rating scale, but 
then dropped on the last time. The drop 
might have been due to the fact that most 
clinicians rushed through the last rating, as 
they were free to leave when they finished it. 

Because of the partial confounding of main 
effects with interactions in the greco-latin 
square, it was impossible to measure directly 
the interaction between specific variables. 
Fig. 1 suggests considerable interaction be- 
tween the mode of presentation and the pa- 
tient being rated. The relative contributions 
of order, sequence, and interaction, however, 
cannot be computed. Another indication of 
interaction effects is that the variance estimate 
based on the square residual, a rough indi- 
cator of interaction and error, approaches 
significance (p of .05). 

From Figure 1 it is clear that, particularly 
when only visual cues were presented, the four 
patients’ mean accuracy ratings differ widely. 
When only the written transcript of the in- 
terview was presented the mean accuracy of 
ratings for all four patients showed much 
more agreement than for any of the other 
three modes of presentation. 

Predictions of patient responses. The ac- 
curacy of predicting a patient’s actual sentence 
completion response was not appreciably af- 
fected by which of the two clinicians con- 
ducted the interview, so, as before, the scores 
were combined for the same patients and 
conditions of presentation. 

It can be seen from Figure 2 that when the 
clinicians saw only the silent movie of the 
interview their predictions of the patient’s 
responses were poorer than chance. In other 


Table 3 


Analysis of Variance 


on the Accuracy of Ratings 


Degrees of Variance 

=n ot aan on Fedor estimate F ratio 
oia 205.7 3 67.57 5.86*** 
Sequence 158.6 3 62.87 A 

ode of presentation 274.3 3 91.43 ae 
Patient 133.0 3 44. ao 
Square residual 1,949.0 176 11.07 lil 
Within cells (error) 2,825.8 191 ` 


Total 


X Signi level of probability. 
me Significant Ae Orilevel of probability. 
*** Significant at .001 level of probability. 


Co 
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ERROR !0 
SCORE 


SILENT 


words, under such conditions the clinician 
was more apt to be wrong than right in his 
Predictions. For all the other conditions the 


Predictions were considerably better than 
chance. 


CORRECT 16 
PREDICTIONS 


SILENT 


WRITTEN 
Fig. 1. Mean accuracy of personality ratin, 
of observation. Lower error 


WRITTEN 
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PATIENT A 
PaTIENT B 
“PATIENT C 
patient D 


E 
SOUND COMPLET 


i itions 
gs of four patients under different condi 
Scores indicate greater accuracy. 


b ne 
redictionS pe 


To determine how many P > alone, 


basi 
could expect on a chance b AE 
empirical probabilities of designa 
the four choices for all the ee 
pleted sentences were determin 


SCORES EXPECTED 
ON A CHANCE BASIS 


% XH PATIENT Å 


D 
—— PATIENT GC @— PATIENT 


SOUND COMPLETE 


Fig. 2. Mean accuracy for predicting responses of four patients under 
different conditions of observation. 


—- 
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Table 4 


Analysis of Variance on the Accuracy of Predictions of Patients’ Responses 


Source of variance Sums of Degrees of Variance 

estimate squares freedom estimate F ratio 
Order 26.9 3 8.97 — 
Sequence 32.8 3 10.93 1.05 
Mode of presentation 974.9 3 324.97 33m 
Patient 383.2 3 127.7 Tages 
Square residual 171.1 3 57.23 552" 
Within cells (error) 1,827.2 176 10.38 
Total 3,416.7 191 


Jt Significant at .01 level of probability. 
ignificant at .001 level of probability. 


abilities for the thirty-five correct responses 
oi Cach Patient were summed and are repre- 
ented by horizontal lines in Figure 2. 

n the analysis of variance done on the 
eia ition scores, the same four variables or 
e were considered as in the case of the 
sis B 5: Table 4 gives the results of the analy- 
ing Variance. Clearly the mode of present- 
Nific e interview material has a most sig- 

a effect on the number of correct pre- 
ce the clinicians were able to make. 
ences ly the only statistically reliable differ- 
tion Were between the silent film presenta- 
and each of the other three modes. 
ound y the case of the ratings, it was also 
Side that the particular patient being con- 
red influenced the accuracy of predictions. 
ken a and sequence of presentations Be 
Squ No significant effects. However, the 
‘ste residual was found to yield a sig- 
Jace F ratio suggesting some possible ee 
er ction effect. In comparison with the ef- 
S ct of different modes of presentation, this 
anas residual is so much smaller that little 
efi t is cast on the significance of the Singi 
ect of the mode of presentation. Figure 
®ems to indicate further no appreciable in- 
*taction such as was the case in Figure 1. 
lationship between predictions and rat- 


igs. The rating-error scores ad the number 
sige ce predictions were correlated and the 
tha> Of the coefficients reversed to indicate 
nate eee which the accuracy of per- 
Dredicy, rating was related to the accuracy of 
Cory, ‘cting patient responses. The resulting 
5, elation coefficients are contained in Table 


Besides showing very little relationship be- 
tween the accuracy of the two evaluation in- 
struments, there is even a suggestion that 
under the condition of sound only the two 
instruments are measuring inversely related 
phenomena. 


Discussion 


Several quite certain, several speculative, 
and several practical interpretations can be 
made of the results of this study. When trying 
to rate a patient’s personality or predict 
his behavior, it helps considerably to know 
what he says about himself in an interview 
situation, whether one reads or hears what he 
had to say. Where the predictions of sentence 
completions were made from just seeing a pa- 
tient, the results in all four cases were poorer 
than could be expected on a chance basis. 
The increment in accuracy was considerable 
between the silent film presentation and the 
three other presentations (Figures 1, 2) which 
all had verbal content cues in common. One 


Table 5 


Relationship Between Predictions and Ratings 
under Different Conditions 


‘ A Number of 
Made of interview Bo a 
presentation r eo, correlated 

Silent film -28 1.92 48 
Written transcript -22 1.51 48 
Sound recording br 2.19" 48 
Complete sound film .03 .20 48 
Allconditions combined 14 2.00* 192 


* Significant at .05 level of probabili: 
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might expect such results on a common sense 
basis except for the discovery that as a group 
the judges actually did worse than if they had 
used a chance system or predicted an “aver- 
age patient.” It may well have been that 
judges were misled by dress, appearance, ges- 
tures, or facial expressions. 

Another definite finding was that some pa- 
tients can be much more accurately pre- 
dicted or rated than others. However, although 
the “normal” subject’s responses were best 
predicted he was not the easiest to rate. Also 
with the ratings some patients were more ac- 
curately rated on the basis of one type of 
observation but were quite poorly rated in 
other situations. Thus there do not seem to 
be clear and consistent differences in the ac- 
curacy with which different patients can be 
judged that hold up for different media of 
observation and different forms of appraisal. 
There is some evidence that patients whose 
sentence completion responses were more av- 


: appreciably 
, which of the two Measures is the 

measure of ability to judge others, 
and consequently the mos 


: l t valid measure to 
use in comparing the valu 


s e of different inter- 
view cue material? Quite clearly the two 
judging processes are different, According to 
Wallins’ classification (6) the ratings would 
be considered analytical-type judgments, in- 
volving some degree of abstraction and the 
predictions would be nonanalytical or em- 
pathic-type judgments. Taft (5) suggests 
there is no necessary relationship between 
these two methods of assessing ability to judge 
others, which was well demonstrated in this 
study. Whereas Taft points out that per- 
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sonalities and other characteristics of judges 
are associated with success on either type E 
measure, results from this study suggest thal 
the cues available to judges also have a dif- 
ferential value for the two types of judg- 
ments. > 
Another explanation exists for the aiey 
ences shown in Figures 1 and 2, where E 
ratings show gradual improvement with a 
dition of cues while the predictions imp a 
up to the sound-only condition, but E 
drop in accuracy with the complete a 
film. In the former condition the judges, W! 
each added bit of observation data, ve g 
proximating the unlimited access to t TH 
tient which the criterion judges had. otal 
their accuracy improves as the Eee aul 
situation approximates the criterion ae a 
with possible biases based on a patiente Fe 
pearance operating both on criterion vee. 
perimental situation judges. Where me ee 
rion was based on the patient’s ee sen- 
response to an open-ended incomp a ap- 


tence, opportunity to observe ng pat ghtly 


pears, if anything, to have ha hi 
detrimental effect on accuracy. Althou £ his 
results of this study are only Sugeest pre 
difference has important implications jterio” 
diction studies. For instance, if a ae by 
such as job success is determined ee ses OF 
supervisors with certain consistent ecesstl 
errors in judgment, prediction of a take 
employees” should somehow include ri- 


account of these biases or errors 10 rate 
terion so as to produce the most tat 
predictions. However, if the criterion asute 
sort of performance or achievement 
little influenced by consistently biase 
riors, prediction of success would E ae 
be best accomplished by measures fre Fro 
and conducive to objective apprals? ni ues 
this point of view, neither of the a can be 
for determining ability to judge othe if poth 
considered more “true” or basic, qiffere”t 
are appropriate representatives O others: 
kinds of judgments we make about ©” + rat 
Because the differences in accuracy, cond 
ings and predictions between the thr not 3% 
tions containing content cues were acl f 
tistically significant, the safest A e 2 
would be that, in general, with th g 
information-gathering, diagnostic tYP 
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terview, there are no appreciable differences 
introduced by the different sorts of cues avail- 
able to the judge as long as the content of 
the interview was available to him. The in- 
teresting trend towards poorer predictions 
with the addition of visual cues to content and 
auditory cues should be subjected to further 
Study with a greater number of patients to be 
observed, and limitation of the study to only 
the two conditions, so as to reduce the amount 
of variance introduced from other less relevant 
Sources. If one accepts the conclusion that 
the three conditions produce essentially simi- 
ar results, a number of practical recom- 
ae can be made. For financial or 
to considerations it is frequently possible 
em. only verbatim transcripts or sound 
on ae of an interview for use in research 
raised Er purposes. The question has been 
ade as to whether such material is an 
em representation of the original ses- 
Sen or whether a complete sound film was 
is Bri It would appear on the basis of 
iia I that written protocols or sound 
even ings are quite adequate, and perhaps 
Predi Superior where the purpose is to gain 

\ctive knowledge of a person. 
ee this study was not done with 
Sens Ployment or selection interview as the 
Binni of the conclusions from this study 
h „ Variations in selection interviewing 
vantages be found to be useful and ad- 
fon Often at considerable expense 
loyer Onvenience to both applicant and em- 
the result Personal interview is arranged. If 
S obtained in this study hold for the 


Se, 
Bae of employees, then it might be 
by ei for the applicant to be interviewed 


Sou. ‘Phone or for him to submit either a 
Ih etview ne or a written protocol of an 
Mteryje conducted by some recognized local 
this « Ver. The employer could then have 
actually re interview appraised without 
Middle, aving to see the applicant. Fay and 

8 sal on (2) report better results in select- 
Whe S Personnel by a similar technique. 
Satisg ®t such a procedure would emotionally 
gn Employer who has become accus- 
Westign Seeing anyone I hire” is another 


ag ticeable reduction in variation of 
ing error scores in the written tran- 


4lo 


script condition shown in Figure 1, invites 
some explanation. In the other three condi- 
tions the appearance of some expressive be- 
havior of the patient is observable and may 
tend either to aid or mislead the clinicians. 
With the written transcript there are only the 
bare words used by the patient, which evi- 
dently have more nearly the same significance 
or cue value to the clinicians. Specific in- 
stances of the helpful and confusing effects 
of these noncontent cues will appear in an- 
other paper. Also because it was impossible to 
control whether a clinician reread parts of the 
written transcript, or to know how well each 
person could hear the recorded spoken words, 
variation in accuracy due to misunderstand- 
ing was doubtlessly reduced with the written 
protocols. 

Because this study was based on recorded 
interviews and the judges were limited to ob- 
serving someone else interview patients, the 
results cannot be immediately generalized to 
all “live” interviewing. They do, however, sug- 
gest that interviewers should be careful to 
avoid being misled by a patient’s appearance, 
should critically consider how they use ex- 
pressive cues, and should continue to rely 
heavily on what a patient says. 


Summary and Conclusions 


Interviews with four patients were recorded 
on sound film to study the sorts of observa- 
tions that aid the clinician in making ac- 
curate judgments of a patient’s personality 
and predictions of his verbal behavior. The 
interviews were presented as silent films, 
written transcripts, sound recordings, or com- 
plete sound films to forty-eight psychiatrists, 
social workers, and psychologists, who made 
ratings of the personality characteristics and 
predicted the responses to incomplete sen- 
tences of the patients who were interviewed. 

The following conclusions can be drawn 
from this study: 

1. There was marked and significantly 
greater accuracy of personality ratings when 
content cues were included, as in the written 
transcript, sound recording, and complete 
sound film, as compared to the silent film. 
Although this difference was the only clearly 
significant one, there was a general trend 
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with considerable variation from case to case 
for the ratings to improve in accuracy as 
more and more cues were added. 

2. Markedly and significantly better pre- 
dictions were made from written transcripts, 
sound recordings, and complete sound films 
than from silent films which actually led to 
predictions which were worse than could be 
expected on a chance basis, 
difference from the trend towards gradual im- 


well each pa- 

responses pre- 
dicted. In the case of the predictions, the level 
of predictive accuracy varied for different pa- 
tients but the pattern for each patient over 
the four modes of presentation remained quite 
ratings some pa- 
rated in one con- 


l l Suggesting con- 
siderable interaction between the effects of 


4. Noa 


ne ppreciable relationship was found 
e 


ween accuracy of personality ratings and 


F. Harold Giedt 


correct predictions, which probably can be 
accounted for on the basis that the two evalu- 
ation techniques may tap quite different as- 
pects of personality, and also are based on 
somewhat different sorts of cues. d 

5. No definitely superior medium was foun 
for recording diagnostic-type interviews for 
studies of judgment of others so that any 
choice between written protocols, sound K 
cordings, and complete sound films can 
made on the basis of practical considerations, 
or factors not covered by this study. 
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Jective assessment of personality is 
problem in psychological research. 


Past fifty years many approaches 
lem have been undertaken, which 
d questionnaires, paper and pen- 
leS, projective tests such as the 
and TAT, sentence completion 


instru thers. The results with these vari- 
ments, while sometimes positive, 


een : F 5 
less 21n the minds of many investigators, 


a 


n : A is 
have felt encouraging. These investigators 


Un : 
of hanging 


fenseg» Y, 


Esen 


that to attempt to assess fixed or 


Mtrapsychic traits such as levels 


ti > 
tion One independent of the stimulus situa- 


Man, © Or : : 
an ecord these traits. For this reason, 


ticing Search 


vason 
Uni S A 
AS, ar 


Rta, is inve, 
Nt ( S 


1 
o terviey” 


ch 
(Useq ta 
e 


“ workers, as well as many prac- 
lans, use the equally unreliable 
n the sense of unstandardized) 
as their instrument of assessment. 
&lven for this is that the inter- 


exible and allows one to explore 


e 
e = behavior for each individual. 


nterview presents a “dynamic” 


tiran 
eee Was supported by a research 
eee the National Institute of Mental 
ational Institutes of Health, U. S. 
ervice, 


of this study were collected while all 


Were š = z 
edicine. at the Washington University 


stimulus situation so that every individual is 
given an opportunity to manifest his unique, 
and presumably learned, social or interper- 
sonal behavior patterns (18). 

The notoriously low inter-interviewer agree- 
ment on assessment of personality patterns of 
functioning for given series of subjects (12, 
15) has made the interview subject to criti- 
cism also. It is important, therefore, if the 
interview is to be an instrument of research, 
to ask what could be achieved if the interview 
were standardized. Chapple (1-6), working 
primarily in applied anthropology, has been 
developing just such a standardized interview 
during the past several years. A review of 
this development and of the instrument, the 
interaction chronograph, used for making 
measurements of the interaction between in- 
terviewer and interviewee during the stand- 
ardized interview, is now in preparation and 
may be consulted for a more thorough de- 
scription than is possible below. 

Essentially, the interaction chronograph is 
a device which allows an observer to record 
in time units with a high degree of precision 
the behavioral interaction è of two individuals 
in terms of some ten or more variables. These 
variables, definitions of which are given in 
Table 1, are objectively recorded by a series 
of electrically controlled counters which are 
connected to two keys, one for the interviewer, 
the other for the subject. Each key is de- 
pressed whenever the designated individual is 

3 Records include only such behavior as number of 


utterances, number of interruptions, their durations 
etc., and not the content of the verbalizations. ú 
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Table 1 
Definitions of Ten Interaction Chronograph Variables for Which Reliability Was Determined 


1. A’s Units: The designation “A” is used rather than 
“Pt.’s units” since interviewees other than patients 
are often recorded. This counter provides a fre- 
quency count of the actions of the interviewee. Each 
time he is active, and the observer depresses his key, 
the unit counter adds one unit. Thus a cumulative 
record is made of the number of times the individual 
was active during a period designated by the signal 
counter. In view of the fact that different people 
have different units of action during comparable 
interviews or time periods, Chapple divides each of 
the following variables (2-9) by the number of A’s 
units and thus obtains mean values which make 
possible comparisons between individuals. 

2. Tempo: The present machine does not record inter- 
viewee actions and silences separately (these, how- 
ever, can be computed readily when desired). 
Rather, this counter records the duration of each 
action plus its following inaction in a single measure. 
Thus it provides an index of how often one starts to 
act; the duration from one action to his next action; 
or his “tempo” of starts. 

3. Activity: This, too, is a duration measure derived 
from an individual’s actions and silences. However, 
unlike Tempo which is a measure of actions plus 
silences, the activity counter adds actions and sub- 
tracts silences. The cumulative record indicates, 
therefore, for any interview sequence, how much 
more active a person was than he was silent. Thus, 
the activity counter is an index of a subject’s 
“energy level,” states Chapple. 

4. A’s Adjustment: This counter, unlike Tempo and 
Activity, does not operate all the time the machine 
is on. It records only durations during which the 


Person interrupted B (the other person) or failed to 


respond to B following the latter’s last action; both 
of which are fail 


ures of adjustment by A. The 
counter adds the durations of interruptions and sub- 
tracts from these the durations of failures to re- 
spond. Thus a positive “adjustment” score indi- 


cates that on the average A interrupted longer than 
he was silent. A neg: 


co 
: uentY X et 
10. B’s Units: This counter provides a freq inte 


+.” subject 
verse. One would expect a type of hase a bent 
to earn a positive score while some nce scot 
individuals should earn negative adjuster 
5. B’s Adjustment: The other individual Sa Aar y). 
(i.e., the adjustment of the pisia Ki in 
For a description substitute “B” for “4 
above. m rds 
6. Initiative: This is a frequency counter stot Bi 
only after a period in which both A and ; ie relative 
(both keys up). It provides a measure at s the initi- 
frequency with which one person, A, a die just 
ative as against the other person, B. d subtracts 
one each time A takes the initiative an con w 
one each time B takes the initiative. A Paat 
initiates more often than he has to be "o indicati 
earns a plus score whereas a negative score 
the converse. which re 
7. Dominance: This is a frequency Sn ie action 
cords only during an interruption ( dae of the 
with both keys down). It provides a me on, A, out- 
relative frequency with which one i f there 
talks or out-acts the other person, B, W ii i 
been an interruption. The Dominance pem or suv 
one if A dominates B in a double ac score indi- 
tracts one if B dominates A. A positive i 
cates that A was more dominant Bien oe J 
exchanges, and a negative score the Sesek countè 
8. A’s Synchronization: This is a freq: interrupts 
which records the number of times A has att times 
B or failed to respond to B, i.e., the A escribe? 
A failed to synchronize with B. The ie ative n 
counter, A’s Adjustment, records the ter their fri 
tion of these events; the present coun a 
uency. „diyda 2 
9. Bs i erfion eiiis The other individ n inte 
chronization (i.e., the synchronization stitu e 
viewer, usually). For a description 5 cit 
for “A” in (8) above. 


ally t ef 
of the actions of the other person (usualy rv 


z ime the 09 ge. 
viewer). It adds one unit each time chang 


‘ative score indicates the con- depresses B’s key during an interaction® J 
sidu? 
« . s ini i divid, 
talking, nodding, gesturing, or in other ways tained. In addition to containing interact 
communicating (interacting) with the second counters for each variable, the ree wh f 
person. Values for these variables are cumula: chronograph has a “signal” coun start 0 
tive and can be abstracted from the printed functions as a marker to record the 8 
foals K the pg ivi with little dif- different periods of the ei ay (7, d 
culty. Some of these variables ma: Goldman-™? gk 
unusually arbitrary, since they re So pig a f 


9, 10), working independently 1 tru ty 
have found that the use of this ersonal r 
for the objective assessment of an ifr 
Patterns is made more difficult by p differ? 
ences in “interaction patterns per i 
interviewers. Furthermore, any tient 
viewer may use with any given P% 


oping his inter- 
has found these 
l than the first- 


order variables from which they were ob- 
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small portion of the entire range of interac- 
tional behavior available to him, as shown in 
à recent study of a diagnostic interviewer by 
Saslow eż al, (17). Thus, it has been demon- 
ete that the differences in inter- and intra- 
interviewer interaction patterns have a subtle 
very marked effect on the interviewees’ 
A on patiems when these are carefully 
result ems recorded. These experimental 
varian, elp to define some of the uncontrolled 
view nee which in the past has made the inter- 
less p hiding the interviewer’s behavior, a 
menter z adequate research tool. Experi- 
as an > seed attempted to use the interviewer 
esus ependent variable in their efforts to 
(the ie various interviewee characteristics 
indicara ent variables). But experience has 
Man-Kisle and the results of Chapple, Gold- 
e “int, er, and Saslow eż al. confirm, that 
i Stina a is not an objective scientific 
Sie and that, in fact, interviewers are 
standardi, dependent, in the sense of un- 
ized, variables. 
ne en of differences between interview- 
recent a convincingly demonstrated in a 
Althou ie 3 by Raines and Rohrer (15). 
filleq at using an approach (psychiatrists 
diagnose rating scales and gave psychiatric 
Which = following a screening interview) 
Goldma as different from that used by both 
Rohrer n-Eisler and Chapple, Raines and 
conclude: 
e 
Pothesie tS of this study support a “projection” hy- 
© account for the variance between psy- 
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chiatrists observed here; that is, that one of the 
major variables responsible for variation between 
psychiatrists in impressions of patients is the differ- 
ing personalities of the psychiatrists themselves (15, 
p. 732). 


It is little wonder then, for example, that the 
science of psychotherapy has made so little 
headway when its effects have been “evalu- 
ated” by various interviewers (16). 

Chapple has developed a standardized inter- 
view in order to facilitate the process of mak- 
ing the interviewer (and the conduct of 
the interview) an independent variable, and 
thereby to permit comparison of results in 
different settings obtained by different inter- 
viewers, or results obtained by the same in- 
terviewer at various times. Chapple’s stand- 
ardized method involves certain “rules” for 
the interviewer to follow in his own inter- 
viewing behavior and in the over-all conduct 
of the interview itself. The standardized inter- 
view is divided into five periods; with periods 
1, 3, and 5 as free give-and-take periods, and 
period 2 (silence) and 4 (interruption) as 
stress phases of the interview. The charac- 
teristics of this standardized interview are 
shown in Table 2, whereas the “rules” govern- 
ing the interviewer’s standardized behavior 
are given in Table 3. 

Thus Chapple’s standardized interview pro- 
vides a means for eliciting a sample of pa- 
tients’ behaviors (dependent variables) in a 
complex but miniature, molar, interpersonal 
situation, the characteristics of which to a cer- 


Table 2 


Characteristics of the Standardized Interview 


Duration of period 


Period Type of interviewing Fixed duration Variable duration 
I z 
Free 10 minutes 
Ir . 12 failures to 
Stress (Silence) vesgondi ot 18 
minutes, which- 
ever is shorter 
T Free 5 minutes pa , 
St Int tio interruptions or 
ress Qifemnipton 15 minutes, which- 
ever is shorter 
y Free 5 minutes 
Total 20 minutes plus a maximum of 30 


more minutes 
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Table 3 


Standardized Interviewer’s Behavior 


Rules for Interviewer 
Periods 1 to 5 (all periods): 


a. Interviewer introduces each period by a 5-second 
utterance (following his signal to the observer). 
All interviewing must be nondirective. No direct 
questions, no probing or depth interviewing. Inter- 
viewer can reflect, ask for clarification, ask for more 
information, introduce a new topic area, etc. In 
general, interviewer’s comments should be nonchal- 
lenging and open-ended and related to the patient’s 
past comments or to some new, general topic. 

c. All interactions must be verbal only, or verbal and 
gestural at the same time; i.e., interviewer cannot 
use head nods and other gestures alone. This rule 
simplifies the observer’s task. 

- All of interviewer's utterances must be of approxi- 
mately 5-seconds duration. 

e. After patient finishes a comment or other inter- 

action, interviewer must respond in less than J 

second, except as otherwise noted in Period 2. 

Each time patient interrupts interviewer, the latter 

must continue to talk for 2 more seconds. This rule 

insures more explicit definition of a patient’s as- 
cendance-submission pattern than would be possible 
if interviewer “submitted” immediately. 


Periods 1, 3, and 5: 


b. 


a. Interviewer must never interrupt patient. 

b. If after interviewer makes a comment patient does 
not respond, interviewer must wait 15 seconds and 
then speak again for 5 seconds, 


Period 2 only: 


a. Interviewer must “fail to respond” to last inter- 


action of patient a total of 12 times (or for 15 
minutes, whichever is shorter), 


b. After intetviewer has been silent for 15 seconds 


(and patient has not taken initiative) interviewer 
makes another 5-second comment, 


Period 4 only: 


Seconds after patie 
c. After having inte: 
continues through 
mit), interviewer 
patient has finishe 


rrupted patient, 
the interruption (does not sub- 
Bee not interrupt again until 
atie 1S utterance, i.e., į i 

ae asap ee ce, i.e., Interviewer 


ent only once durin 
ance of the latter if patient does not “ n Riter 
d. The period is en 


yield.” 
ded after 12 interrupti 
minutes of attempting to obtain these. rp 


a a re UE 
tain degree are objective and Predefined (in- 
dependent variables). Such controlled “field” 
situations would seem to hold promise of 
improved assessment of personality, 


if the patient 
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The aim of the present study was oa 
vestigate the consistency of scorable oe. 
tion patterns elicited from ee E 
viewed independently by two gieren She 
viewers in a standardized manner. ee 
question was asked, “Will patients be nae 
the same way in independent interview vail 
two interviewers, if the latter employ Fr Put 
interviews and interviewing beara y pos- 
differently, the question was asked: liabilities 
sible to obtain inter-interviewer Te t itudes 
of patient interaction patterns e 4 
higher than those obtained by Ka tigators) 
Rohrer (and numerous other inves Sewe 
when the behavior patterns of the inte ty indi 
are more controlled and less gs ee recog 
vidual, uncontrolled variation? I hie of th 
nized at the outset that the prob ae 
reliability of the measuring oe a 
confounded with the question of ecu ing 
or invariance of the interaction pa reaso 
measured by this instrument. It was ‘ol! 


3 vara 
that high reliability cofficients On the pility 


abil 
variables would tend to indicate io d 
of interaction patterns of patients of meas 
also the reliability of the ismune at cortelt 
urement; whereas low or insignificy, 5 ethe 
tions would not permit one to leor factors)” 
the unreliability was in one of thes 


the other, or both. 


Procedure 


. chn 

After they practiced the interview t5 int! 
described in Tables 2 and 3 in SO. scot 
views each, the objective nem the Wee 
of the interviewers indicated coat with d 
approaching the prescribed pa was acne m 
high degree of accuracy. This = unduly At 
without the interviewers feeling tient 
hibited in their responses to the ba jniti@ 
this. point the present study nee each g 
The design called for twenty pat! the tw? w 
be interviewed independently as youns we 
terviewers, one of whom was ing, and t 
ternist experienced in interview < were f 
other an older psychiatrist. The clinic 0 3 
patients sent to the psychiatri" ing and pef 
large Midwestern clinic for S f 
signment to individual psychot 
were new patients, white, 
women, ranging in age o ae 
18 to 55. The presenting prob 


cor 


ji 


in 
T5 
d 
f the 
t was 
ance 
pein 
ped 
$ 


igt! 


3 
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cal of the population of this outpatient clinic, 
and consisted of cases of anxiety reaction, 
hysteria, depression, schizophrenia, obsessive- 
compulsive neurosis, duodenal ulcer, and pos- 
sible chronic brain syndrome. 
s design was randomized to control order 
er S 2 each interviewer thus interviewed 
the Me er patient first; an AB order with 
= patient and a BA order with the 
Ren : etc. In this way each interviewer 
on es in the sequence for ten patients 
2, on for the remaining ten. Statistical 
as fen of these “interviewer-order” effects 
nea oes behavior was therefore possible. 
viewer's a were removed from the inter- 
be Eou esk so that patient smoking would 
EXperir raged. No mention was made of the 
ment by the interviewer, and the experi- 


men 
mat began when the interviewer opened the 


Inte i 
is ned with such a statment as “My name 
Deneq. ——. Can you tell me how you hap- 


ei to come to the clinic at this time?” 
for „ ntetviewer pressed a concealed button 


ra A 
Sery; light signal to the observer. The ob- 


i er t 
Other sian seated in the next room on the 


: ide of a large one-way window (5 ft. X 
designated eoorded the interaction by pressing 
Patient A buttons for the interviewer and the 
from ae high-fidelity microphone was hung 
the o Ceiling and connected to an amplifier 
tecordeg Vers room. The side effects of the 
Controlle ipa in the observer’s room were 

Tou Y piping the voices to the observer 
Ment, s earphones. Throughout the experi- 
of A Ound recording and visual observation 
cording eactions were excellent. Verbatim 


by hae of the interview exchanges was made 
rictophonce recently devised highly sensitive 


S, Connected directly to an Audo- 
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graph machine in the observer’s room. The 
Audograph discs were transcribed for sub- 
sequent studies (content analyses, etc.). 

The second interviewer was always in an- 
other building when the first interviewer was 
conducting his interview, thereby insuring in- 
dependence; both began with zero knowledge 
about the patient. After finishing his inter- 
view, the first interviewer would say, “Mr(s). 
, I’d like another doctor in our clinic to 
talk with you now, and if you will wait here 
a minute or two I will go to get him.” Upon 
his arrival, the second interviewer signalled 
the observer and the second half of the ex- 
periment began. 

Subjects were used in the order in which 
they were sent to this particular clinic. How- 
ever, due to power failure in the hospital on 
one occasion, and to total incoherence on the 
part of one patient, two of the consecutive 
planned experiments were lost. 


Results 


From Table 2 it is seen that twenty min- 
utes of the interview are fixed and that, de- 
pending upon the subject’s behavior in periods 
2 and 4, thirty more minutes are possible to 
complete the standardized interview. Table 
4 contains an analysis of the actual mean 
length of the twenty pairs of interviews. It 
can be seen that the standardized interview 
takes, on the average, about 33 minutes to 
conduct, and that both doctors had essentially 
equal interview times. Furthermore, the order 
of the interview, comparing all 20 first inter- 
views or all 20 second interviews—independent 
of which doctor was first or second—yielded 
no differences in mean length of interview 


Table 4 
Analysis of Mean Length of Total Interview for 20 Patients Interviewed Twice 
Analysis Mean Range 
Length of all 40 interviews 32.8 minutes 25.7 to 50.3 
a. Length of all first a 
interviews (WV = 20) 32.9 minutes 26.9 to 41.4 
b. Length of all second x 
Interviews (W = 20) 32.8 minutes 25.7 to 50.3 
Length of all first doctor’s 3 
interviews (W = 20) 33.5 minutes 26.9 to 50.3 
Length of all second doctor’s É 
interviews (N = 20) 32.2 minutes 25.7 to 41.2 


422 


George Saslow, Joseph D. Matarazzo, and Samuel B. Guze | 


Table 5 


Means, Standard Deviations, Ranges and Coefficients of Correlation Across Total 


Interview for Each of the Major I-C Variables 


Variable Dr. 1 Dr: 2 £ $ 
1. Mean Pt.’s Units 72.20 69.85 AT 01 
SD 25.55 20.90 
Range 25 to 127 29 to 112 7 01 
2, Mean Pt.’s Action* 59.85 56.25 -956 À 
SD 56.90 54.60 
Ranget 13 to 243 17 to 257 ` 01 
3. Mean Pt.’s Silence 920 8.30 759 i 
SD 3.11 2.41 Gr 
Rangef 5 to 17 3 to 14 o1 
4. Mean Tempo 57.20 52.85 908 i 
SD 36.87 27.26 
Ranget 24 to 159 26 to 142 01 
5. Mean Activity 39.55 36.20 930 i 
SD 40.49 30.01 
Rangej —2 to 150 2 to 131 oi 
6. Mean Pt.’s Adjustment —1.53 —1.28 802 , 
SD 1.33 1.17 
Range 0 to —5 0 to —4 01 
7. Mean Drs Adjustment  —1.83 =153 731 
SD 1.17 80 
Range —3.57 to +1.00 —3.03 to +.14 ot 
8. Mean Pt.’s Synchron. 84 84 726 i 
SD 07 .06 
Range -63 to .99 -76 to .98 01 
9. Mean Dr.’s Units 62.79 59.74 772 
SD 22.78 18.28 
Range 21 to 109 27 to 93 06 
iven value 
T Rounded tcnniables2 through 7 are given in hundredths of a minute. To convert to seconds, multiply aS iH 
tio 
: , intera or 
when subjected to statistical analysis. It is of the total interview) of nine of the M yjiven Ha 
interest to remember that, relatively speaking, chronograph variables. Values rs of on 
B ae were placed on the lengths of each doctor, with Pearson coefic nt ry 
in rs Bie te sre (ie., patients could vary relation shown in the second po 5 be 
the lenethe of treet these periods such that the last. The results show a stri intel y 
€ lengths of these periods could in i i iables from first wer 
say, one minut c range from, in interaction variables e tY 
h ie to fifteen minutes). Table 4 to second interview, for each © (y 
Indicates that even with this freed, i i P 
the patients behaved similar] dom to vary, patients. F PE teractio” ws 
this variable with tre en arly in regard to The stability in patients: a of ™ met 
mean lengths in minute ita interviewers, The terns (and corollary reliability aph) isd) 
respectively, were 8.4] por yA two doctors, ment by the interaction a S` of 
= : ‘tt m period 2 i 5 in seve pat", 
(r= 631), and 3.68 and 2.26 in seit a ee oH 


first observations thus Point to 


of stability in the interaction 
! , atter 
tients in a standardized interiiew. necat pit- 


Table 5 presents, for the 20 patients, the 
means, standard deviations, and ranges (for 


the existence 


relative reliability between, patier pill 


manifested by each of 


the two doctors, and (b) absolute W 
of these same interaction patterns: from of! 
Relative reliability is inferre ment opt 
values of the Pearson product-m0% ey 
ficients of correlation shown wfricie? k if 
column from the last. These COM” npt” 


from .726 to .956 and are all sig”! 
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Ol level of probability. They indicate that, 
for the interview as a whole (summing all five 
Periods), each of these 9 interaction chrono- 
oo variables has a marked stability, i.e., 
fee a interviewers will elicit these pat- 
which Tom each of the 20 patients in amounts 
thes „ate; relatively similar for any one of 
e individuals. 
Denia: since one can get high values of 
poe. or any one variable when 2 inter- 
i a elicit different amounts of this varia- 
ive os the same patient, providing the rela- 
tom Gmi of these amounts are maintained 
are in yo to patient,* these high values for 
Strate va =a not sufficient to demon- 
i variance’ ility in the sense of stability (or 
o ny In patient characteristics. 
examine eae the latter, one needs to 
tanges for, values for the means, SD’s, and 
interviews any one variable across the two 
Cates an ts. Examination of Table 5 indi- 
for these equally striking absolute reliability 
t Wo 9 variables for the 20 patients with 
Spite veny a tewens, Thus, for example, de- 
B interaga ed individual differences in 
ay on rate of the 20 patients (pt.’s 
zs , en by the fact that patients varied 
7 units with Doctor 1, and 29 
Octor 2, the average number of 
d an aiot 20 patients was 72 with Doctor 
3a Pite tha St 70 with Doctor 2. That is, 
y Mminuteg act that, during an interview of 
Pai es age length, one patient inter- 
woth r Bea (less than once a minute) and 
Paes ith pent 127 times (4 times per min- 
bet 2, any e b and similarly with Doc- 
whe his P k individual seemed to main- 
n doctor interaction rate independent of 
do Vidua] i Was interviewing him. Thus one 
Zt nteracted 25 times with the first 
tes, Tet Subjen times with the second, while 
Pectivety. ct interacted 112 and 129 times, 
wey similar: the two interviewers. This 
ast Tity in values of the means, as 


e & t 
bt One coul T striking similarity in stand- 
4 EN 

Tuay pits, D ee a perfect correlation (1.00) on 
3 Mber Bt do bia Ple, if the second interviewer 
Units Ra or some other multiple of the 

Tom the same patients; i.c., if from 
Obtaj ot 30, 40, and 50 units, and the 


loo, 0, 80, and 100, the value of r 


ctor g 
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ard deviations and ranges for all the variables, 
would tend to indicate, when added to the 
high values of the Pearson 7’s, that these 
interaction variables reflect stable and in- 
variant personality characteristics under these 
standardized conditions in the subjects studied. 
Before leaving Table 5 several other findings 
should be pointed out. The first is the finding 
that how active (“action”) a patient is on the 
average, is a more stable or invariant charac- 
teristic from interviewer to interviewer (r = 
956) than is any other variable measured. 
Average length of silence, on the other hand, 
while fairly stable is less so (r = .759). Tempo 
and activity, which are algebraic summations 
of action and silence, are very stable (.908 
and .930) and yield values similar to those 
reported by Chapple on 12 subjects (2). 
Chapple gave no reliability figures for the 
other variables. 

It is of interest to note also that the two 
interviewers interacted with the patients in 
similar ways. From Tables 2 and 3 it can be 
seen that no attempt is made to standardize 
how often the interviewer should interact with 
the patient. Except for somewhat defining his 
number of units in periods 2 and 4 (thus con- 
trolling his behavior in 12.8 minutes of the 
total 32.8 minutes) he is free to follow the 
patient’s initiative in regard to this variable 
during the three remaining free periods (20 
minutes). Despite this freedom the two doc- 
tors had similar average numbers of Dr.’s 
units of interaction (63 and 60, with an r of 
.772) and similar “adjustments” (algebraic 
sum of durations of interruptions and failures 
to respond). 

Table 5 contains values for only 9 of the 10 
variables defined in Table 1. Values for Dr.’s 
synchronization were not included because in- 
spection revealed a very limited range in the 
scores for this variable—at or very near 1.00 
throughout—making statistical analysis of 
little usefulness. The value for r for Dr.’s syn- 
chronization was —.058, while the values for 
the means, SD’s, and ranges were .98, .029, 
and .94 to 1.04 for Doctor 1; and .96, .050, 
and .84 to 1.02 for Doctor 2, respectively. 
The values for this variable are an internal 
check, and indicate that the two interviewers 
did in fact follow the standardized rules very 
closely and, except in periods 2 and 4, which 
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Table 6 


Coefficients of Correlation for Two Interviewers for Each of the Major I-C 
Variables in Each of the Individual Periods of the Interview 


Pt.’s Dr.’s Pt.’s E Dee 

Pts Pts Pt.’s adjust- adjust- S aeaa pr 

Period units action silence Tempo Activity ment ment niza E 

I -126 .685 845 665 593 .809 476 784 

I 554 817 899 -802 .832 -136 pile ‘O24 436 

Tt 365 485 121 496 471 334 212 "625 591 

IV -508 -553 -849 435 609 811 -696 “006 (432 

Y 517 135 479 -736 -135 .820 771 76 ‘772 
Total 747 956 759 -908 -930 -802 737 . 


Note.—For r = 444, p < «05; for r = 561, p < 01. 


will be discussed later, they neither inter- 
rupted nor failed to respond, therefore earn- 
ing scores near 1.00 on this variable during 
the various periods. Due to the nature of the 
construction of the present form of the inter- 
- action chronograph, the very brief pauses of 
the doctor which occur in give-and-take in- 
teraction before he responds to the patient are 
recorded as if they were failures to respond. 
Thus an interviewer who adequately follows 
the standardized interview behavior will score 
one failure to respond for each of his units, 
and thus will earn a score of 1.00 instead of 
0.00 on synchronization. 
A word regarding the shape of the distribu- 
tion of scores for each of these variables is in 


order, All variables yielded normal, or bell- 
shaped distributions, e 


- 78-86). If nor- 
e necessar 
transformation method; 


a are appli bl 
he remarkably stable r ae ae (78). 


3o meals 
relation are given in Table 6, wile ae 1, 
and standard deviations = shown 1n i 

r the analysis by periods. snn] theo! 
ii Apia <a ales and statistical | re 
can describe (the Spearman-Brown D in gem 
non), individual samples (periods) & fe ovet 
eral less reliable than the total samp“ -opa 


«ante? interact? 
all interview). Thus patients a peri 
behaviors during the 10-minute are Je 


or 5-minute fifth period, for examples Fe f 
reliable from interviewer to inen 8 inv! 
are the values based on the total N a 
interview.® Values for the total parison: 
reproduced from Table 5 for ate ho 
There are several striking fin show? iy 
in Table 6. Of the 45 correlations 5 arel? 
the 9 variables in the 5 periods, se 
nificant at the .01 level and 10 T 5, 0 
.05 level of statistical significan ig to red 
8 period-variable combinations f these jot 
statistical reliability. Three of PT zat 
contributed by the patient’s eo fro 
variable—an artifact which re nd for off 
very limited range of scores es doct 
variable and described earlier p 5 
synchronization. of 
gee across variables for a ii 
periods, one is struck by z a us) oF 
reliabilities found in period 3- ctive 
periods 1, 2, 4, and 5 have, ia el a 
8, 7, and 5 r’s which reach the ‘ re 


son be 
seyation e 
5 An example analogous to the iy o 0" ge 
scribed is the low test-retest es while cig” F) 
the Wechsler-Bellevue subtests (.6 $ d by a with 
liability of the Full Scale IQ (derive’ “Tin, 
adding of these subparts) is remar 


r of .97 (19, p. 13). 
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Table 7 
\ Means and Standard Deviations for Two Interviewers for Each of the Major I-C 
Variables in Each Period 
n Pt.’s Pt.’s Pt.’s Pt.’s 
Peri units action silence ti 
I ~ Dr.1 Dr. 2 Dand Ds Dr.1 Dr.2 Dr. 1 De. 2 
= 19.55 18.35 74.45 65.25 7.40 8.65 82.25 74.30 
UM 10.10 9.20 68.02 45.92 2.44 2.50 66.90 44.30 
SD 12.85 12.35 60.90 69.40 12.70 11.55 73.90 81.10 
mM 3.02 2.24 59.40 81.60 8.24 6.33 56.57 79.56 
. SD 9.35 10.75 67.75 79.25 10.70 9.30 78.80 88.90 
“ Iv M 5.05 5.70 44.70 127.76 4.52 2.72 45.35 127.80 
SD 17.55 15.20 21.00 8.85 645 5.80 20:75. 15:10 
Vu 6.22 3.54 49.74 3.47 3.10 1.78 49.55 3.75 
SD 12.90 13.20 75.90 59.30 8.40 7.40 85.50 67.05 
Total M 7.14 6.10 124.12 67.82 2.60 1.80 122.82 66.71 
SD 72.20 69.85 59.85 56.25 9.20 8.30 57.20 52.85 
25.55 20.90 56.90 54.60 3.11 241 36.87 27.26 
Pt.’s 
Pt.’s Pt.’s Synchro- Dr.’s Dr.’s 
Perigg Activity Adjustment nization Adjustment Units 
th Dri = Dr.2 Dr.1 Dr.2 Dr 1. Dr. 2 Did Dr2 Dr.1 Dr, 2 
SD 67.15 56.85 —1.17 —1.81 94 96 -— 57 — 47 19.05 17.79 
uM 69.35 47.55 1.28 1.47 .07 05 26 20 9.67 8.73 
m S? 48.30 57.94 =111, — 99 25 35 —9.90 —8.95 3.21 3.10 
tM 63.10 84.00 213: 1.34 18 5 5.54 4.12 2.31 2.20 
w SD 57.20 69.95 —2.16 —1.54 1.02 1.00 —1.06 — .74 9.68 10.63 
M 44.65 127.75 2.31 1.86 04 08 1.13 59 5.19 5.56 
y SD 14.50 3.10 —1.53 — .99 98 99 91 1.28 17.84 15.21 
M 50.25 4.45 1.80 2.41 .07 = .06 1.08 -70 5.30 2.04 
Tota) 2 67.65 51.85 =1.50 —. 95 .96 .95 —.81 — .61 12.74 13.00 
al M 125.10 68.75 1.09 1.20 06.08 54027 6.28 5.03 
SD 39.55 36.20 —1.53 —1.28 84.84 —1.83 —1.53 62.79 59.74 
| 40.49 30.01 133 147 07 = .06 1.17 80 22.78 18.28 
i 
l 
: 0, 
tiog an : á i 
4o 3 has gs Which reach the .05 level, pe- invariant from doctor to doctor under all 
at the 05 Values at the .01 level and only conditions explored other than that involv- 
tig ince Beri Ro ing silence stress. 
tig’ similar P 3 1s a free give-and-take pe- The reason for this finding is not apparent 
Whe for this © periods 1 and 5, the explana- at present. It may reflect, among other things, 
tei than į IScrepancy must be sought else- a true patient-instability in this regard rela- 
of SA tentati the structure of the period it- tive to other patient characteristics, or it 
prettiog z -Ve hypothesis is that the stress may reflect actual differences in doctors’ 


edi 2 (si ; 
th ictan) (silence) is such as to make un- 
les e fr ; 3 5 
m interviewer to interviewer 


silence behavior in period 2. Slight evidence 
for the latter was demonstrated by an analy- 


§ medi 

bar’ D. itely following behavior of the sis of the effect of “order” of interviewer 
in ets will, ut differently, a group of 20 upon patient interaction patterns. By use of 
tiog Cir ta, cact to silence stress (as seen a covariance design utilizing two conditions 
to 3) differ ately following behavior, pe- (an AB order for 10 Ss and a BA order for 
Meg ho ihe ently, depending upon the doc- the other 10 Ss), values for the over-all inter- 
tera ition ausing the stress. A still further view for each of the variables were compared. 


this same phenomenon is: in- 


ction 
terns of patients seem relatively 


Thus it was possible to determine, for exam- 
ple, if Dr. 1 elicited more units (etc.) from 
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the same patients relative to Dr. 2, depend- 
ing upon whether he, Dr. 1, interviewed these 
patients first or second. Despite individual 
differences in the means for these variables 
for the 10 patients interviewed under condi- 
tion I, relative to the values for the 10 dif- 
ferent patients interviewed under condition 
II, there were no differences in the means 
(Mı versus Mə, and M; versus M4) between 
the two doctors, for eight of the nine vari- 
ables. Thus, for these variables, it made no 
difference which doctor interviewed first or 
which interviewed second. 

This was not the case with the patient’s 
“average duration of silence” variable, how- 
ever. For this variable it was shown that in 
the second series of 10 patients, Doctor 2 
coming first had the significant effect (F= 
4.66, p=.05) of eliciting more silence in 
these 10 patients when they were seen im- 
mediately following this experience by Doc- 
tor 1. On the other hand, Doctor 1 did not 
produce this effect on the 10 patients he saw 
first as reflected in their “silence” behavior 
pattern with Doctor 2, who saw them im- 
mediately afterward. The values of M, and 

2 were 7.9 and 9.1, while the values for M; 
and My, were 9.3 and 8.7. Thus Doctor 2 had 
the effect of changing the patients’ average 
duration of silence with Doctor 1 from 7.9 to 
8.7 when he, Doctor 2, came first, whereas 


the silence of these patients with him was the 
same whether he 


it is certainly 
only be dis- 


comments from three “ z j i 
terviewed by the stand. hi 


foes ard interyj 
indicated that they fou tae Method 


nd the “silen : 
ment” more stressful than the “ ce treat 


: interruptions.” 
These three subjects, like a dozen or ho - 
chologists and psychiatrists who have a. 
served one or more of t 


hese interyj 
rviews 
through a one-way screen, were relatively 
unaware of the interruption stress, i.e they 
Ba 


did not perceive the change in interviewer 
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behavior in period 4. The silence stress a 
apparent, however. Possibly there are A 
tural factors involved here. Each of E f 
long history of reinforcement in res T 
being interrupted by others. e t D fail 
culture, it is very unusual for anyon aa 
to respond to us. Thus, silence stres a 
unusual experience and is thereto i spect” 
more disrupting than interruption. evant? 
lation would appear to have some T 


a js 0 
in view of Hebb’s theoretical analys optim?! 


search by various organisms for yet a theif 

level of excitement or stimulation l 

environment (11, pp. 551-552). Table 6 js 

Another point worth noting 17 nt in 

the r of .136 for patient’s mie pene and 
riod 2. Because of the nature of pen „vati 
the method of measurement, this P of Ue 
able does not reflect the similar $ octal 
patient’s adjustment with the pe, the 
Rather it reflects the correlation De" "intel 
This ©, tet’ 


behaviors of the two doctors. int 
t’s fal 


records the “durations of the pat! 


jent’S 


ing to the patient in an effort D a i 
latter’s level of initiative. THEA on few 
tient’s adjustment counter can espon to 
any failures of the patient to r on of af 
doctor and still fewer interrup am 13 d 
since he is not responding. The i st ó 
an artifact and reflects the, Yor few H 
range derived from the relatively ts 


É atiet 6 
the two doctors restimulated ees failu" 


t 


ing this period with the subse ath 
respond on the part of the Pe abil ity 
A truer reflection of the Te aii en 
two doctors for the patients a J id 
der the stress of silence will Pe 8 
Dr.’s Adjustment column 1m 2 
counter, recording how long a 
failed to respond to the pa stoh fl 
latter took the initiative, ther afar on ? 
this counter, yields a clearer oa si 
stability of a patient’s an an s 
The r of .864 indicates that Pa emen a 
markably similar in their adju inte i 
interviewer’s silence in the wo ot 
Finally a word should be Frid 2 
relatively higher 7’s found in P 


n i 
ruptions” and “durations of the an tte) 
ures to respond to the doctor Se docti, j 
ance.” However, in period 2 a respo" y 
standardized behavior involves ” 
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of them in the .80’s) as compared to the 7’s 
of period 4 (with five 7’s below .60). Why 
should patients show more invariance during 
Silence than during interruption? (Note this 
Fee compatible with their subsequent re- 
a of ‘this “greater” silence stress in pe- 
dind as discussed earlier.) The answer is not 
stud in the present data and therefore more 
ee Is required. However, from a purely 
that teal point of view it can be pointed out 
rn ints 2 is a much “slower” period, con- 
action” on the average little two-way inter- 
tiod hy such. Accordingly it is an easy pe- 
Would : the observer to record. Thus one 

“ a high reliabilities. Period 4, on 
Dace” Sih hand, typically involves a “fast 
Ee both patient and doctor talking at 


ame time, i 
ifficult e. The observer has his most 


Possible 
r. In ord 


time during this period. Hence, a 
explanation for the lower values of 
teliability to check this point, as well as the 
Crvieyy y of observation during the total in- 
Single dace have designed a study in which 
Ously a will be recorded simultane- 
Using Independently by two observers 
c o0 interaction chronographs. 
has stated that the behavior of 
uring the two stress periods yields 
°tsonalit. information regarding individual 
Videq ia Yy make-up. Accordingly, he has pro- 
is the Jai Measures of this behavior. The first 
Mteryje “ative shown by patients during the 
Seco on silences of period 2, while the 
tien oe Dominance pattern of the pa- 
‘od 4 "8 the interruption stress of pe- 
Initiativa ; 

Whic dig defined as the frequency with 
When ; Patient can respond or interact again 

S Partner fails to respond to him. It 
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is measured in the interaction chronograph 
by a frequency counter which adds one each 
time the subject initiates an action follow- 
ing a period during which both people are 
silent and subtracts one each time the in- 
terviewer starts an action (because the sub- 
ject failed to do so for 15 seconds). This fig- 
ure will be negative if the interviewer is 
forced to start more actions than the subject, 
and positive if the subject shows more initia- 
tive by starting more actions than the inter- 
viewer. In order to control for differences in 
number of units during this period, the net 
count described above is divided by the total 
number of units during period 2. 

Dominance is a measure of an individual’s 
relative ability to “talk others down” in 
double actions. It is a reflection of one’s 
ascendance-submission pattern. Measurement 
of this variable is made only during the fourth 
(interruption) period. The obtained score is 
the difference in the number of times one 
person out-talks or out-acts (dominates) the 
other when both have been talking or acting 
at the same time. If the subject dominates 
the interviewer the greater number of times, 
the score is positive; if he submits more fre- 
quently to the interviewer’s interruptions, the 
score is negative. 

Results for these two variables are shown 
in Table 8. Here one finds a striking stability 
in the initiative variable (r= .805) and a 
lower but still significant reliability (r= 
470) for the dominance pattern. The earlier 
comments regarding possible observer error 
in period 4 are again pertinent here and stress 
the need for the mentioned observer-reliability 
study. The mean values for initiative and 
dominance in Table 8 indicate that patients 


Table 8 


Means, Standard Deviations, Ranges, and Coefficients of Correlation for Two Interviewers 
for Initiative (Period II) and Dominance (Period IV) 


: Variable Dr. 1 Dr. 2 r 
* Mean initiative (Period II) 75 805 
SD 18 : 
2. Range .17to 94 .23 to 1.00 
Mean Dominance (Period IV) —.32 —.42 470 
SD 31 30 
Range —.71 to +.83 —.92 to +.29 
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show a fairly high rate of initiative under 
silence and tend, on the average, to submit 
more than they dominate when interrupted 
by an interviewer. There are, however, very 
marked individual differences in these inter- 
action patterns, as can be seen in the SD’s 
as well as in the ranges of variation. 

Further effects of the silence and interrup- 
tion stress can be seen in Table 7. Here it is 
shown that, relative to their own values in 
the other four periods, patients have a longer 
length of “silence” in period 2 and a consid- 
erably shorter length of “action” in period 4. 
The longer average patient silence in period 
2 is of interest since it indicates that patients’ 
interaction patterns, while relatively invari- 
ant on any one day from interviewer to in- 
terviewer, when these latter are following a 
standardized pattern, are nevertheless sensi- 
tive to changes in the stimulus situation 
(intra-interviewer’s behavior). Thus in period 
2, when the interviewer deviated from his 
period 1 pattern of responding immediately 
at the end of the patient’s utterance (from 
silences of less than 1 second, to 15 seconds), 
the effect was to produce a concurrent in- 
crease in the patient’s own duration of silence 
(from 7.40 to 12.70). It was subtle observa- 
tions such as these which led Chapple to 
standardize the interviewer’s behavior. 

At this point a word might be said about 
the implication of this latter finding in regard 
to the question of stability or instability of 
interaction patterns. The results discussed 
earlier indicate that when the behavior of in- 
terviewers is standardized to some degree one 
ae highly consistent Patterns from subjects. 
pick apr ee is for comparable 
Pe ies eee behaviors and 

i -interviewer changes. 
changes in the interviewer’s 
periods 1 to 2 are associated wi 
in interviewee reaction patter 
new patterns havin 


ear, therefore, that there 


F ity) for com 
stimulus conditions and Jack eee 


(changeability) for changing st 
tions. Without the latter one w 
with an inflexibility of intera 
which would make the study 


of invariance 
imulus condi- 
ould be faced 
ction behavior 
(and eventual 
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predictability) of ae patterns of limited | 
usefulness in psychology. n in 
The question can be raised a Be: 
whether the obtained stability in ne a 
patterns from interviewer to i Jatters 
any one interviewee was due to econd i 
repeating the “same story” to the E as 
terviewer, or some similar artifact. Eo 
probably not so since verbatim ert majo! 
interviews show that there were © first a 
differences in content between the es might 
second interviews. Military apene a h 
be a prominent feature of the se resented 
yet hardly alluded to in the secon i one 9 
desertion by a spouse might domin a d 
more subsections of the first interv 
not be mentioned in the second, ae. a 
ords show also that psychotherapeut 
couid occur in the first acer 3 á cleat 
ported in the second, preter n 1 talk 
identifying remark such as, didn't 
to the other doctor today, I @ obvio”! 
that . . .” etc. Some patients ee pan! 
less emotional in the second gastos 
the first. These differences pot i 
consecutive interviews in baer eza 
insight, emotionality, etc., wil ds of abe 
in detail by a variety of metho “er, 0 Py, 
of the verbatim materials. Howe ncesi T 
of these clinically obvious differe fas sily 
tients in the two interviews, ther” atte 
marked stability in interaction P i l 
any one patient. ade id 
Some nosttenien comments rate ot 
to the interviewers or to doc Se than if 
clinics, such as “I liked you Or all g 
other doctor—I didn’t like him thi 
was upset by those doctors—I re 
and said things I hadn’t tionen i ize 
etc., emphasize that (2) the s ai patie? W 
terview is compatible with SS ee i 
actions common to any niie pa omn g 
terview, (b) the interactiona a the P& 
interviewer is not mentioned ee 0 
who is presumably not a utilizi” 
and (c) the possibility exists 0 a ic 
standardized interview as 4 i 
servational device that can be ints 1 “erty 
number of times at different PO ther int 0 
longed psychotherapeutic OF he od? 
tional relationship, without “ac 
or practice effects. 
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Discussion 


ae of this study would tend to in- 
BoA considerable stability of patient 1n- 
one ages is demonstrable if there is 
trol of the’. of the stimulus situation. Con- 
Morien i stimulus has been overlooked all 
search SA Se is sb and psychiatric re- 
indicated “4 F interview. Our experience has 
ciently nia he interviewer may be a suffi- 
Without at i“ led or independent variable 
natural or the same time introducing un- 
Neither i ee interviewing behavior. 
though ex e Ss themselves nor uninitiated, 
Who Blige ic eas professional interviewers 
iets “4 the interview indicated by their 
hen cond at the standardized interview, 
Viewer, ig gt an experienced inter- 
atric interviews ifferent from other psychi- 
ow j 

Under the”? the demonstration of reliability 
Not exh, Conditions here investigated does 
ability St the questions concerning reli- 
Stability the obtained reliability indicates a 
t items Patient personality patterns with 
Current] Viewers on the same day. We are 
Which 4 Conducting a reliability study in 
rot interviewer interviews the 
Dart, ent on two occasions one week 
; us the completed study reported 
Aterviey, ved same-day reliability across two 
s aa while the study now under way 
pith A eat reliability study over time, 
1 reliat tg interviewer. Finally, since the 
Speri oe reported here for our first 
oe es unusual in psychological re- 
ne Š > ving complex variables such as 
access y A the interview, we have felt it 
ie Current] cross validate our findings and 
zng an EA doing this in a replication uti- 

li ere g ~~ design. 
tabil; 5 Te several other aspects of the re- 
roblem which should be pointed out. 
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i Fe Of these is the reliability of the ob- 
Cording of the interview. He is an 
VianetS a the instrument and the final 
oe lity op ° 00 more reliable than the re- 
ie o oa? of his input. We plan 
Gee g this aspect of the reliability 
Me į $4 having two observers record the 
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Also to be examined is the reliability of the 
scorer who abstracts the objective scores 
from the numbers printed by the counters. 
The interaction chronograph yields cumula- 
tive scores on the several variables and thus 
scoring, which involves primarily simple arith- 
metic skills, is a reasonably objective pro- 
cedure. For the study here described a second 
person followed Chapple’s manual of instruc- 
tions and scored independently the interaction 
chronograph records of ten of the interviews 
selected at random. The results indicated per- 
fect agreement between two scorers on 96 per 
cent of the 600 individual final scores in- 
volved. The magnitudes of the errors involved 
in the remaining 4 per cent were very mini- 
mal; they were of the order of 1 unit in 
whole number scores and .06 unit in those 
variables involving hundredths of a unit. 
Thus it would appear that scorer reliability 
presents no problem in these observations. 

A question which is of considerable theo- 
retical as well as practical interest is the re- 
lation between content of verbalizations and 
the interaction patterns of individuals during 
the interview. Chapple has taken the position 
that these patterns are relatively invariant 
and are negligibly related to the topics one 
is discussing (4, p. 33)- We plan to investi- 
gate this interesting question in subsequent 
research. We plan also to examine the pos- 
sibility of differences in interaction patterns 
in various diagnostic groups. There is reason 
to believe that schizophrenic patients may 
have patterns different from those of hys- 
terics, or of manic-depressive patients, etc. 
So far, only a few patients have been ex- 
amined with regard to the possibility that in- 
teraction chronograph variables may reliably 
discriminate one category from another (5). 
The interaction chronograph may permit a 
refinement in differential diagnosis by its po- 
tential for objective or operational definitions 
of patient characteristics. 

Finally, the question of validity of the in- 
teraction chronograph scores must be consid- 
ered. Establishing the reliability of an instru- 
ment is only the first step. Consideration of 
the meaning of the obtained scores is, of 
course, a necessary second step. The ques- 
tion of validity is a complex one and will be 
approached in a number of different ways 
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(predictive, content, concurrent, and con- 
struct validity). The study described above 
involving different patient groups is one of 
these approaches. However, there are various 
others. For example, one can ask, What are 
the behavior correlates in real-life situations 
of these measured interaction chronograph 
variables? Other approaches might involve 
use of the method in assessing the effects of 
psychotherapy in time; the immediate test- 
retest changes in interaction patterns follow- 
ing the administration of controlled doses of 
drugs which induce affective changes that can 
be reliably communicated by verbal report; 
the influence of status and role of the inter- 
acting participants upon the measurements, 
etc. Finally, an approach which may have 
considerable importance is the possibility of 
developing techniques for planned behavior 
therapy; ie., will having the interviewer in- 
crease the length of his utterances with de- 
pressed patients increase the duration of ut- 
terances of the latter?, etc. 


Summary 


The present study was concerned with two 
problems: an investigation of the reliability 
of the interaction chronograph as an instru- 
ment of research and the corollary problem 
of the variance or invariance of interaction 
patterns of patients during a standardized 
Psychiatric interview. Twenty outpatients 
were interviewed independently by two dif- 


ferent interviewers under previously defined 
and practiced condition. 


T consistency) and a 
eraction patterns when 
ns are changed in a 
interviewer vari- 
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choe, problem facing the researcher in psy- 
cesses a. that of accounting for the suc- 
Widely hi one by therapists who differ 
its treatm, oth their theories of neurosis and 

e v Eysenck (6) has questioned 

thers i, of all these reported successes. 
Question 4 skeptical, have considered the 
i ae what these therapists do or have 
Salient me reasoning that this must be the 
investipatio atic force. Fiedler (7) in an 

erapy a of three orientations to psycho- 
erian, con “te Freudian, Adlerian, and Rog- 
telationshi uded that it was the quality of the 

erapists A hich was common to successful 

Wenn all three schools. 

Spect to T, the question is still open with re- 
telationee transpires, as a result of this 
Successful 5 being offered, that makes for a 
the exp Outcome, Therapists generally offer 
the un pane that the relationship permits 
learning moe of some responses and the 
full Soe Others to occur, but they do not 
learning. Sve to what constitutes the critical 
3 it is Essie (11) is coming to believe 

t fear th aming to accept fully and with- 
OWrer 19 positive feelings of another.” 
unlearn (10) feels that the patient has to 
been Used solving behavior which has 
to occy to prevent certain sign-learning 
C Medyin ae Shoben (13) sees therapy as 
ent leg’ fects in social learning, the pa- 
an į si to react without anxiety to hu- 
Dd eco ions which involve impulses that 
Olar ä me associated with punishment. 
4 ee (4) emphasize the fact 
ma, ai ionship permits previously in- 

Y be exti responses to occur so that they 

inguished. 


Mowrer (9) counterposes his own position 
to that of the psychoanalysts, which is essen- 
tially that of Dollard and Miller. He does not 
feel that the neurotic’s difficulties arise be- 
cause of overrestraint and unrealistically high 
moral standards, and he does not believe that 
superego functions or values can be influ- 
enced by psychotherapy. The study reported 
here bears on this issue. In the main, we un- 
dertook to test the following hypotheses: that 
values do change in psychotherapy, particu- 
larly moral values since these are thought to 
be at the center of neurotic conflicts; that 
the patient learns to accept the moral values 
of the therapist, and that alleviation of 
psychological distress accompanies this new 
learning. It was hypothesized too that values 
such as those found in the Allport-Vernon 
Scale of Values would not be systematically 
influenced by psychotherapy, since these 
would not ordinarily be at issue either in the 
neurosis or its treatment. 


Procedure 


Patients at the Henry Phipps Psychiatric 
Clinic were accepted for the study only when 
they and their doctors agreed to take all 
the necessary tests. No patients diagnosed as 
psychotic were included. Some high school 
education was also made a requirement for 
inclusion since many of the items on the 
tests could not be understood by people of 
low education or intelligence. 

Many patients who were considered eligible 
never completed the experiment. Some were 
too upset to take the tests or had had shock 
therapy. Others took the tests initially but 
left against advice shortly thereafter, either 
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before arrangements could be made for retest- 
ing, or else with a flat refusal to be retested. 
As it turned out, it took two years to accumu- 
late twelve patients who were tested before 
and after therapy. Of these, nine were hos- 
pitalized or “house patients,” while the re- 
maining three were treated on an outpatient 
basis. Six were male, six female. Diagnoses 
included psychoneurotic, 
physiologic, 
ranged from 


therapist 


patient, 
ed that a therapist treats 


compared. The 
the patient being 
all thoughts and feeli 
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did he think helped him to feel better? How 
did he feel about his therapist? What did 
feel about therapy, terminating therapy; ; 
future? No mechanical recording was E 
of the interview since it might have E 
rapport and the willingness to speak free 

Immediately after the interview, a a 
report of it was made by the author. ting 
could not have entered into the repa i 
without prior knowledge of the test re in 
At the end of the experiment, all twe i ri 
terviews were rated independently k the 
judges on a 7-point scale as to whet euti 
patients benefited or not by their therap 

experience. 


f Values wes 

The Allport-Vernon-Lindzey Scale of Va js- 
administered in the usual way. The Syme rome D. 
ability Check List was developed by coe rescat 
Frank and his colleagues in the coon ani o 
on the response of patients to individua sists 0, 
therapy. It has not yet been published. 

41 symptoms such as “headaches, 
“unusual fears,” etc, which are rate adit 
a 4-point scale of distress, and Te a 
rated on a 6-point scale of severity. 

The Butler Haigh set of 100 statemen mt ror (8 
by its authors as a Q sample, was a F statemi 
our patients by asking them to sort t yell; are i 
into two piles: 1. Do not describe yon n ike Y" 
so true of you; are more unlike you ee you 
do zot apply to you so well. 2. DE ts e 
well; are true of you for the most Pa m 
you more than unlike you; apply to ¥ to obt 
not. Since we wished by this procedure Scaler 9s 
score based on the Dymond Age and i } 
dichotomous sorting was quite adequa 
a simple task for the patients. EA, 60 

The Moral Values Q sample consis havior ® 
ments based on three main areas of E arise? ul 
which psychological conflicts cone turn 8 
aggression, and authority. Each area Ki se! 
divided so that two generally contrasti cach 
tudes are represented with respect 
Thus, there are six categories: eo” 


l 


jonal 


inten 


stat 


F 5 2 
1. Sex-rigid: sex is seen as evil, maa a 
sary evil, dirty, to be shunned, postP ; 
pressed. ee 
2. Sex-free: sex is seen as good, healthy 
to be accepted, enjoyed, understood. viol 
3. Antiaggressive: acts of aggression: ced, 
pain infliction are thought of as W o 


avoided, suppressed, suffered. of 3 
4. Aggressive: aggression is tote a. Ż w 
sary, rewarding, to be accepted, exP or det ple! 


iscipline: jr? 
5. Disciplinarian: authority, discipli?”®: ` gesi 


sary, 
regulation are seen as absolute, neces" 
to be accepted, supported. 


hret 

tic 

Di 

f resë 
qg g | 
| 

plue 

5 
ite” 


| 
| 


Moral Values and Psychotherapy 


6. Libertarian: authority is seen as a relative mat- 


a with individual responsibility and reason pri- 


Moral values were thought to involve be- 
Gis which is seen as right or wrong, good 
of fe ele or not permissible, worthy 
which ote ia punishment. Items were sought 
selected ; reflect such attitudes. Ten items 
other sou rom therapy protocols and from 

ontrove TCes were written for each category. 
eelings rsial Issues which aroused strong 

55 Were given priority since it was felt 
would more generally arise 

Such issues. The statements are as 


thes Sex-Rigid 
“1S a wife’ ; 
husband, e’s duty 
15, I irls should come to the marriage bed as virgins. 


ee taste to tell dirty jokes in mixed com- 


to have intercourse with her 


- Me i 
ate | who have sex relations outside of marriage 
heaped and contemptible. 
i Kate 1S never justified. 
one, Should not marry before they are twenty- 


- Sexual = 
Durper Intercourse should be had only for the 
a6. Se of having children, 


cst and truest love is one without sexual 
S2, Putts and feelings, 


be abot nes featuring sexy love stories should 


57, ished, 
“sturbation is a sin. 
4. Tes b Sex-Free 
er: 4 à 
‘ eck fectly all right for teen-agers to kiss and 
- Men 
fore wught to have some sexual experience be- 
16, Sexy Marriage, 
Xual 5 
21 Cautif, jtercourse provides one of life’s most 
1, A Wo. u experiences, 
man if fi may be justified in having another 
28 peds, er husband is not satisfying her sexual 
34 > Ostitug: 
i Unnat tion should be legal. 


4p. Sime, al sex acts should not be considered a 
*2Xpla 
45 factory” before intercourse makes it more satis- 


EX educats 
` One g cation should be taught in public schools. 
att Xpect one’s wife or husband to be 


e 
Tacteq 
Sex, to handsome members of the opposite 


f 
Youn; ¢ 
Parents ecg dren Play with their sex organs, 
not be worried or concerned. 


f Some, Antiaggressive 
o P 
Other, Ne strikes you on one cheek, turn the 


12. Using live animals for medical research is wrong. 


. Judge not lest ye be judged. 
. One should always try one’s best to get along 


with others. 


. It is wrong to hate. 
. Capital punishment is wrong. 
37. If you're angry, count ten and try to let the 


feeling go away. 


. Wars are never justified. 
- The meek shall inherit the earth. 
- Violence breeds violence. 


Aggressive 


. A man who lives by the sword should die by 


the sword. 


. Might makes right. 
. One should say what one thinks about other 


people. 


. If people annoy you, either let them know it or 


don’t bother with them. 


. Some people are no damn good. 
. Let the punishment fit the crime: an eye for an 


eye. 


. To the victor belong the spoils. 
. A nation that will not defend its rights or its 


honor deserves not to survive. 


. The race is to the swift and the strong. 
56. You have to use brute force to set some matters 


straight. 
Disciplinarian 


. Labor unions should be strictly regulated. 
. One should always be busy and keep one’s mind 


occupied. 


. Children should do as they are told. 

. Parents act in the best interest of their children. 
. Parents sacrifice a lot for their children. 

. “Thou shalt honor thy father and mother” is a 


commandment which should always be observed. 


. Everyone should belong to some church. 
. What our country needs most are great leaders, 
. A soldier should always obey orders first, ask 


questions afterward. 


. Our future lies in the hands of fate. 


Libertarian 


. There may be times when one should break the 


law. 


. People should take time out to relax and think 


about themselves. 


. Parents should always tell children why things 


should or should not be done. 


. Many parents do not really love their children. 
. The trials of parenthood are more than equalled 


by its rewards. 


. Parents often deserve to lose the respect of their 


children. 


. God is created by man in his own image. 
. Famous leaders owe their greatness to the ones 


they lead. 


. An employee should express his opinion, even 


when the boss disagrees. 


. A person must take responsibility for his own 


life. 
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Table 1 


Rho Correlations of Criteria of Improvement 


Signifi- 
df cance 
Criteria Rho (N—2) levelst 
Interviews and SDCL -61 10 -038 
Interviews and Adjustment 
Score 85 g» -001 
SDCL and Adjustment Score AS oF 144 


* Patient D, the first in our Series, 
before we had decided to use the Dym 
and so no measure of change on this cri 
him. 

+ Significance levels were 
suggested by Kendall (8), 


had his initial testing 
ond Adjustment Scale, 
terion was available for 


determined according to procedures 


Patients and therapists were required to 


into eleven piles 
heir belief or dis- 


4, 2, 1. 
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Results 


othesis of the study was that 
Proved would tend to modify 
moral values in the direction 
ts’ moral values, A review of 


The main hyp 
patients who imi 
their system of 
of their therapis 
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the literature makes it apparent that the se 
lem of criteria of improvement is an ae 
one. We used three possible criteria: : ie 
on Frank’s Symptom-Disability Cheeta 
(SDCL); change on Dymond’s Adju 
Scale, based on the patient’s sortings nate 
Butler-Haigh statements; and ee Jat- 
based on the post-therapy interviews.. ve the 
ter are admittedly crude, but they mate 
advantage that in the interview the be a 
could speak freely, and that where of i 
motivated to create an impense be 1e 
provement or lack of it, this cou into e 
flected in what he said and taken } 
count by the judges. 

Patients Hih manked on all thre aie 
the rankings intercorrelated to aerer 
comparability and stability of the 
as shown in Table 1. that the 

From Table 1 it can be s or 
judges’ ratings based on the inter bail a 
related significantly with Tanne List at 
both the Symptom-Disability E Jatter dit 
the Adjustment Scale, but that t a other: A 
not correlate significantly with cae ings er 
thus appeared that the judges par , 
the best single index of improvem in p 


iteri® | 
e cr e 


r e 
To determine the direction of chans a an 


. ient’s ini 
tients’ moral values, each patien 


== 


Table 2 t 
Judges’ Improvement Ratings and Moral Values Correlations 
ith 
x , ings wit 
Correlation Correlation of ee 
of patients’ therapists’ sor ank 
Mean of Rank of initial Le 
ee judges? judges’ and final Initial Final -z 2 
atient ratings* ratings sortings 1 2 a 1 
a 5.3 1.5 AT 108 371 a ; 
5.3 1.5 72 —.003 200 ‘019 5 
Cc 48 3 3 —.01 
D 86 664 05 2 6 
4.7 4 12 
„5 48 443 535 5 2 
E 47 45 .00: 
E Z ; 84 398 402 248 
3 6 -70 173 399 "343 1 
: Sum a i | 
= a 7 .67 .192 015 E 0 8 
0 8 —.13 
7 58 345 226 5 4 
2.8 9 —.05 
J 5 54 451 -406 72 10 
: 10 s 
2 Ae 51 .245 398 3 12 
zo i ae 
L 17 .59 -268 131 214 ’ 
$ 12 .62 -200  —.011 = 
Sum —.549 


* Ratings of Improvement: mı 


uch improved = 6: 
worse = 2; moderately worse = 1 h ae 


i much worse = 0, 


«mproved 
i moderately improved = 5; slightly improved = 4; unimP! 
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final sortings of the moral value items were 
Correlated with the therapist’s sorting. Table 
2 shows the main data bearing on the hy- 
pothesis, 
, The rho correlation of judges’ ratings of 
improvement and change in direction of 
therapist’s moral values equals .68, which, for 
An 10, has a significance level of .016. If we 
ee the changes in moral values of those 
Dee the median improvement rating with 
y ie below the median, we find £= 3.013 
level Ti also significant at the 2 per cent 
e sup us, the main hypothesis appears to 
ported by the data. 
SSR, the changes in the moral values, 
values sidered in relation to the therapist’s 
at hee not very large. This could mean 
ed, it j Ough the system of values is modi- 
ive a as not profoundly altered. An alterna- 
planation is that greater changes could 


Not 
oe © expected since only two of the patients 
thawed as more than moderately im- 


change, In One of these, Patient A, the 
“pe m moral values were quite large. 

be e Ppears too that the hypothesis needs to 

tients nded to account for the fact that pa- 

to k: © were unimproved or worse tended 

tem, so 1/22 from the therapist’s value sys- 

ffecte that changes in moral values may be 

Situation both directions by the therapeutic 
he 

Patiengs g Tence of exceptions to the hypothesis, 


o? be ivo G, and J, indicated that other factors 


a ed as F 
thoy count fo as well as changes in moral values 


Ff r improvement or lack of it. Patient C 
at helped him as much as anything 
Pist, Overy that he was smarter than his 
Mes mentin, ccording to patient E, who had been ex- 
En With Paranoid ideas and wanted to 
the hospital, he was told by his 
he signed out he would have to be 
is pe State hospital since as long as he 
»“fanoid ideas he was insane. This was 
im, Afterward, he began to question his 
Cut what purposes they served him, 

took ae them up. Thus, therapy in these 
A Unusual course where conflicts around 
come not at issue as far as the pa- 
ed Her Wish Patient G “signed out” against 
R to anoth Sband, in service, was being trans- 
thus, With pant Part of the country and she wanted 
Mep At o im, fearing to be left behind. She was 
at 80 at apa cing everyone of her “improve- 
Was pone tho they would let her go. When asked 
any arg oit had helped her, she said that it 
und the other patients, especially those 


dvie, 
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on the first floor (psychotics) and learning from 
them how she should be or should not be. She was 
discharged as unimproved by her therapist, rated as 
slightly improved by all three judges, and made her- 
self out to be considerably improved on the Symp- 
tom-Disability Check List and the Adjustment Scale. 
Patient J spontaneously remarked that therapy had 
taken away her former values and had not replaced 
them with anything. She felt “confused” at the time 
of her discharge but was planning to continue ther- 
apy on an outpatient basis. Thus, the effect found 
here might be one of therapy-in-transition. 


To test whether similar changes would oc- 
cur with respect to values of the type meas- 
ured by the Allport-Vernon-Lindzey Scale of 
Values, the score obtained by the patient in 
each of the six scale categories, both before 
and after therapy, was compared with his 
therapist’s scores in the same categories by 
means of the D technique (3). Four pa- 
tients’ profiles on this scale became more 
similar to their therapists’, eight less similar. 
Change in similarity to the doctor’s profile 
showed a rho correlation of .18 with amount 
of improvement. Since this is not significantly 
greater than zero, we cannot assume any sup- 
port for the hypothesis of a relationship be- 
tween changes in such values and improve- 
ment. This accords with our expectations, 
since it was believed that such values were 
not likely to be importantly involved either 
in neurosis or therapy. 


Summary and Conclusion 


Twelve patients at the Henry Phipps Psy- 
chiatric Clinic were given a battery of four 
tests before and after psychotherapy. Their 
therapists were given two of these tests. Pa- 
tients who improved tended to revise certain 
of their moral values in the direction of their 
therapists’, while the moral values of patients 
who were unimproved tended to become less 
like their therapists’. This was not found in 
the case of values such as those of the All- 
port-Vernon-Lindzey scale. 

It was thought that the latter type of values 
showed no systematic change with respect to 
improvement since it was not likely to be 
at issue in the neurosis itself or in its treat- 
ment. Changes in moral values centering 
around sex, aggression, and authority were 
thought to occur because these issues are 
commonly involved in patients’ conflicts. 
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If patients who improve change these moral 
values to accord more with their therapists’ 
moral values, it seems likely that the patients 
have learned to accept part of the latter’s 
value system as their own. Most therapists, 
however, seem to take great precautions to 
avoid influencing their patients’ values in any 
way at all. Shoben (14) emphasizes that the 
patient must evolve his own set of moral 
values and that the therapist must not en- 
graft his own values upon him. It may be 
that the therapist communicates his values to 
the patient in many unintended, subtle ways, 
even when trying to avoid so doing. The pa- 
tient, who is often sensitized to the therapist’s 
every word and inflection, may be able to re- 
ceive these communications, and because of 
his trust, admiration, and respect for the 
therapist, may permit himself to be influenced 
by them. 

It seems likely, too, that there is a direct 
connection between one’s self concept and 
one’s system of moral values. These values 
are an important part of the standards by 
which the self is judged, yet not only the self 
but others as well. Thus, Sheerer’s (12) find- 
ing that there is a direct relationship between 
change in acceptance of self and change in 
acceptance of others is predictable when it is 
considered that both self and others are be- 


ing judged in the light of a changed set of 
values, 


The findings would not seem to support 


superego functions or 
d very little, if at all, 
€ places emphasis in- 


hing normal communi- 
een ego and su 
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Projection, Self Evaluation, and Clinical Evaluation 
of Aggression’ 


Anthony Davids, Andrew F. Henry,’ Charles C. McArthur, 
and Leo F. McNamara * 


Harvard University 


ve 

sci nd the way it is expressed in be- 
Projection cording to an hypothesis of “direct 
Need s ould the two expressions of the same 
aa “hydrants be parallel; while according to 
sion in fants theory,” the amounts of expres- 
Vers antasy and behavior should be in- 


tions based might also make different predic- 


ave been upon more complex relations that 


*Xression Proposed to exist between fantasy 
Whatever and behavioral expression of needs. 
Empirica theoretical position one chooses, 
tateq 2 €xamination of hypotheses is facili- 
ently assessment of some need that fre- 
havior Ow expression both in fantasy and 
e of ne of the most common, as well 
Cally an the most important, both theoreti- 
Within Practically, is “n Aggression.” 

dit A Aggression, it is customary to 
Shae extrapunitive aggression 
( on th itive aggression. In his original 
Ta € Thematic Apperception Test 


; M i 
mp Ce atay (6) pointed to the clinical 
t 


rentia 


Wh , 
A tween hee do psychologists expect be- 
ti © way a need is expressed in projec- 


ha x D the subcategory of aggression 

S otis Taggression.” Rosenzweig, also, 
utilit rated the theoretical and em- 
inp. Y of this dichotomy between in- 


AS st i 
> conduc, i an outgrowth of a program of re- 
ang the ire, at the Harvard Psychological Clinic 
Po ction of Professor Henry A. Murray 
g ination, Th by a grant from the Rockefeller 
tiong titutions | authors are indebted to the follow- 
Publie Mstitute for facilitating this report: the Na- 

g of Mental Health (Grant M-700), 


OWE v7... 
Now at yanderbitt University. 
Queen’s University of Belfast. 


ward- and outward-directed aggression (7, 
8). Moreover, recent research (5) has shown 
cardiovascular reactions to be related to 
“Anger In” and to “Anger Out” emotional 
reactions in response to stress. And these 
concepts have proved useful in sociological 
studies of suicide and homicide (4). 

The present experiment represents an at- 
tempt to further explore relations among 
various measures of n Aggression. Specifically, 
we will relate measures of aggression derived 
from self ratings, clinical ratings, and projec- 
tive protocols. 

Method 


Subjects. The subjects (Ss) were 20 male 
college students who volunteered to serve as 
paid Ss in an intensive investigation of per- 
sonality. They participated in approximately 
40 hours of psychological examination, con- 
sisting of psychodiagnostics, experiments, and 
interviews, conducted by a team of investi- 
gators. 

Projective ratings. The TAT, administered 
individually to each S, was electrically re- 
corded and transcribed verbatim. An experi- 
enced clinical psychologist, who had not 
administered the test and who was not per- 
sonally familiar with the Ss, analyzed the 
stories given in response to cards 3, 6, 7, 8, 
and 13 of the male series. On the basis of his 
analysis, he rated the Ss in regard to both 
amount and direction of aggression. That is, 
upon analyzing each S’s TAT stories, the psy- 
chologist rated him as either high or low on 
aggression as well as rating him as either 
characterized by anger directed inward or 
outward. 

Self evaluation. Included in a comprehen- 
sive inventory of self ratings was a scale de- 
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Table 1 
TAT Rating and Self Rating on Amount of Aggression 


TAT 
Self 
rating High Low 
High 6 5 
Low 6 3 


Fisher's p = .47. 


signed to measure conscious avowal of ag- 
gression. The S was provided with a 6-point 
rating scale running from “much less than 
most people” to “much more than most peo- 
ple,” and instructed to indicate his general 
level of aggression. For purposes of the pres- 
ent investigation, Ss who rated themselves as 
more aggressive than most people were classi- 
fied as high on aggression and those who rated 
themselves as less aggressive than most peo- 
ple were classified as low on aggression. 
Clinical evaluation. An experienced clinical 
psychologist, who had contact with the Ss 
over approximately an 18-month period, 
rated each S in regard to both amount and 
direction of aggression. That is, utilizing in- 
formation gleaned from his personal contacts 
and from his impressions derived from the 
Ss’ responses to a battery of tests and experi- 
ments, the psychologist rated each S as either 
high or low on aggression and classified him 
as either extrapunitive or intropunitive. It 
should be emphasized that the TAT was not 
in the battery of tests analyzed by this psy- 
chologist and that he Was not the same per- 
jective ratings, 
nt of data. Association 


Table 2 


TAT Rating and Clini 


cal Rating on 
Amount of Aggression 
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Table 3 


i Self 
TAT Rating on Direction of Aggression and 
Rating on Amount of Aggression 


TAT 
„o 
Self In 
rating Out 
High 10 1 
Low 1 
Fisher's p = .001. i 
ficance © 


exact method for determining sign! 
association is employed rather than 
conventional chi-square technique > 5 
statistic utilized to report significance 
ings is Fisher’s p. 


(d 
the mor 
s, the 


Results 1, 3! 


A e 

From the results presented in Tabl rat 
appears that the relation bewen aggression 
ings and self ratings on amount 0 mig tD 
is essentially random. This fading e yalidil 
regarded as negative evidence for suggest 
of the TAT. Additional evidente a ro 
lack of TAT validity might be i 
the fact that the relation heemern n f a 
ings and clinical ratings on am do 
gression, shown in Table 2, or, it appear 
Upon further analysis, howev A ne T 
that the seeming lack of validity E 
may be due to an artifact. iie find A 

The reason is suggested by A evid A 
shown in Table 3. Here it ecm sociai 
that there is an almost perfect petween tys 
significant beyond the .001 level, alt ray 
amount of aggression avowed g assess” oy 
and the direction of aggression, vals with Py 
thematic apperceptions. Indivi ding t© i the 
nounced n Intraggression, pune o Ag 
perienced psychologist’s inte oe n 2 
TAT’s, rated themselves as 


Table 4 


. . {f Aggres® 
linical Rating on Direction 0 ; 
Bati pi hes of Aggression 


ion 3 


ae ting 
Clinical TAT a I 
nica! ini Z 
1 = Clinical 
rating High Low rating Ont 1 
High 5 4 High : 
Low T 4 Low á 


mesa aa eee 
Fisher's p = .54, 


Fisher's p = .01. 


Projection and Evaluation of Aggression 


Table 5 


TAT Rating on Direction of Aggression and 
Amount of Aggression 


TAT 
TAT Out In 
High 5 7 
| Low 5 3 


Fisher's p = 33, 


a This finding suggests that the men 
ad nie themselves under the assumption 
e A nly outward-directed aggression was to 
one’s nee in estimating the amount of 
is ae aggressiveness. 
denceq i regard, it is noteworthy, as evi- 
tendeg Y Table 4, that the clinician also 
| amount (6 = 01) to equate a high rating on 
| Out.» o aggression with a rating of “Anger 

ate reing ese statistically significant findings 
the enti orced by the observation that out of 

Tateq oe of Ss only one individual was 
e cline! On aggression by both himself and 

directing Ie and was also rated clinically as 

Was fuli 1S aggression inward. The clinician 

Expressi, aware that need aggression can gain 
erence he In two directions. Yet a major dif- 

TAT Hil eis the clinical ratings and the 

e was that for the clinician high 

While for me was associated with “Anger Out’ 

Nowe coe TAT, as shown in Table 5, high 

of the p n Aggression occurred independently 

Asa wee on “Anger Out” or “Anger In.” 

be. 2 sult, of course, the projective ratings 

andom relation to the clinical ratings. 


Discussion 


the basis of these findings, one might 
© that the TAT measure of inward- 
Conclusio Sr ession is invalid. The alternative 

sb n, however, is that the TAT is mak- 
Te seep due contribution to the case record. 
e bla to us that the latter interpretation is 
Man fs usible, In American culture there are 
Out» en inate means for expressing “Anger 
Xample m A0 quite “proper” situations. For 
eflect ? TAT stories of murder and assault 
Wetyday. an extreme degree, a need that in 
MET Y life may find less drastic expression 
tin, i Ings as changing an appointment, 
Tshly critical of the work of others, 
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or engaging in heated discussion of politics. 
Often the TAT measure of n Extraggression 
will do no more than confirm the presence and 
extent of influence of this need that is dis- 
played in many facets of the case record. In 
fact, the person himself may be well aware 
of his aggressive feelings toward people and 
situations in his environment, and, upon di- 
rect questioning, he may be both able and 
willing to present an accurate account of this 
aspect of his personality make-up. 

By contrast, however, n Intraggression does 
not have many outlets for expression in every- 
day behavior. In fantasy, one’s heroes may 
be victims of fate or may commit suicide, but 
in ordinary life one has little recourse be- 
yond an occasional “accident” or a self-criti- 
cal remark. Moreover, mild degrees of in- 
traggressive behavior are not defined as such 
by society at large. Therefore, it seems likely 
that the intraggressive need will not be writ- 
ten bold over all the case record. Here is 
where an “hydraulic” function is served by 
the TAT—it presents an opportunity to ex- 
press in fantasy a need that rarely gains be- 
havioral expression. 

It seems that we are left with a slight 
variation of an old rule. This version is, “For 
needs with behavioral channels to expression, 
the TAT and behavior are parallel; while for 
needs with few behavioral channels, measures 
derived from the TAT and from behavior are 
inverse.” However, this formulation requires 
further consideration. Actually, both aspects 
of this formulation can be viewed as special 
cases of the general rule that “TAT projec- 
tions are directly parallel to other behavior.” 
The narrator whose TAT heroes feel n In- 
traggression possesses such a need himself in 
real life and it influences his actions, but so- 
ciety prescribes that he can act out this par- 
ticular need with less visible behavior. One 
result of this is that many men who have in 
their TAT protocols the theme “Aggression 
expressed outward followed by aggression di- 
rected inward” were rated predominantly as 
“Anger Out” and “High” in n Aggression both 
by the psychologist and by themselves. It 
seems that only the first part of the theme 
was readily translated into visible behavior. 

Occasionally, however, a shrewd observer 
managed to deduce the complete theme on 
the basis of subtle behavioral signs. For ex- 
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ample, one person, whose TAT heroes all 
evidenced a strong need to direct their ag- 
gression outward but were subsequently “re- 
luctant” to express this feeling, was rated 
correctly by an observer who said that the 
subject was “so suspiciously nice I had the 
feeling there was something going on there.” 
Thus it seems plausible that the relation be- 
tween projected needs and behavioral needs is 
direct parallelism. Vet a projective test may 
add something unique to a case record be- 
cause certain needs find more condoned ex- 
pression in samples of fantasy than in sam- 
ples of any other kind of behavior. When it is 
equally easy to act on a given need both di- 
rectly and in projective situations, however, 
it seems likely that knowledge of the need 
will not be greatly increased by adding a 
Projective test to one’s battery of assessment 
techniques. For such needs one may, at least 
when examining healthy people who have no 
motivation for distorting the data, do quite 
as well by eliciting an $’s direct report as by 
utilizing a complex projective method of per- 
sonality assessment, This point has recently 
been stated rather convincingly by Allport 
(1) and has received empirical confirmation 
in an experiment reported by Davids (2). 
This notion is further substantiated by the 
Table 6, of signifi- 
Ol) between the Ss’ 
self evaluations of whether they were high or 
e clinician’s evalua- 
rs of assessment, of 
ribute. 
that direct methods 


> neurotic 
tail their self- 


Table 6 
Self Rating and Clinical Rati 


ng on Amount 
of Aggression 


Self rating 


Clinical 

rating High Tos 
High 8 1 
Low 3 8 


A. Davids, A. F. Henry, C. C. McArthur, and L. F. McNamara 


would extend his statement and say ge 
since the culture curtails the expre 
certain needs in almost everyone, the F 
will contribute to increased understanding © 
these needs in normals as well as in E 
rotics. In fact, since the behavioral ar in 
of such needs may be even more — nate 
emotionally healthy people, who ae ative 
likely to be “culturally normal,” the Re 
contribution made by projective meh 
be even greater when these needs are sei 
in normals than when they are asse 
neurotics. 


Conclusions E 


d 

In the present study, both the sele g 
clinician, we have inferred, were E that 
and evaluating n Ta aere annels f 
has many culturally sanctioned ch the pi” 
expression. Under these agian the 1% 
jective test behavior and the rest d, in ti 
corded behavior are concordant, “at projet 
sense, nothing unique is added by +9: te the 
tive method. However, it seems of proie™ 
unique advantage and pane one && 
tive techniques becomes evident W whose oe 
amines n Intraggression—a need fantasy i 
pression in behavior other than 


culturally made difficult. 
Received March 18, 1955. 
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Repression and the “Return of the Repressed” 


John H. Flavell 


Clark University 2 


aden! 5) recently conducted an experi- 
repressig Me among laboratory studies of 
again oe content merely to demonstrate 
TAF ag Something akin to repression of 
emory Oclated material may occur in a 
ae ee Zeller further showed 
forgotten miniscence or reinstatement of this 
is later Fi can be seen when the threat 
in his ig from it. The threat used 
of failure dy was that of an induced feeling 
eller ha the performance of a motor task. 
analogue a in fact created an experimental 
(1), His Freud’s “return of the repressed” 
other fe udy deserves to be considered an- 
tions of st” among experimental investiga- 
is | Semi ge phenomena. 
attempt oa Purpose of the present study to 
Present erification of Zeller’s findings. The 
nement. esign incorporates two additional re- 
Matem S, however. First, in order to approxi- 
Clinical ore closely than Zeller has done the 
Teturn aE ditions under which repression and 
Xpecteg the repressed would ordinarily. be 
Ment p to occur, a threat to personal adjust- 
failure fs substituted for Zeller’s threat of 
nas made “hy ona task. Second, an attempt 
turn 6 Iscover whether repression and 
Stal in ¢ the repressed are selective or gen- 
TesSive i effects, i.e., whether or not the 
Red to oe of threat is mainly con- 
(aeclated at memory material most closely 
2) Torn the threat. In view of Korner’s 
x at findings, the expectation 
th k an threat to personal adjustment 
ects, ective rather than general in its 
ayy This M €refore, the study proposes the 
oyp Titteg a formed the basis for a Master’s thesis 
Whos ader the ae University in 1952. It was carried 
bree invaluable on of Dr. Thelma G. Alper, for 
ane N the author wishes to 
W at e. 
© University of Rochester. 


following three hypotheses: (a) a threat to 
personal adjustment will produce a significant 
decrement in the recall of verbal material 
associated with this threat; (b) a partial 
reminiscence of this forgotten material will 
be in evidence after threat conditions are re- 
moved; (c) forgetting and reminiscence in- 
duced by threat and threat-removal will tend 
to be specific to that verbal material most 
closely associated with threat. 


Method 


Subjects 


Thirty-eight college freshmen and sopho- 
mores served as volunteer Ss. Prior to the 
experiment proper these Ss were divided into 
two equal-sized groups, roughly equated for 
nonsense syllable recall. The Ss were un- 
selected for sex, age, or intelligence. 


Procedure 
All Ss were seen individually for four con- 
secutive daily sessions. 


Session I. The Ss of both groups were shown a 
series of twelve nonsense syllables, exposed for two 
seconds each, under instructions to memorize for 
future recall. Two more exposures of the twelve 
syllables followed. The Ss were then instructed to 
write a one-word association to each syllable as it 
was presented a fourth time. Recall Test 1 followed. 
In this and the four subsequent Recall Tests the Ss 
were given four minutes in which to write down 
as many of the twelve syllables as they could re- 
member, 

Session II. For the experimental group Ss, Session 
II proceeded as follows. When the S entered the 
room he was introduced to a psychology professor 3 
and told that the latter had kindly consented to 
“interpret” the S’s one-word associations of the 
previous day as “normal” or “abnormal” with re- 
spect to “those of the general college student popula- 
tion.” The E then read aloud the twelve nonsense 
syllables and the associations the S had previously 
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given to each. The professor commented “abnormal” 
or “normal” after each syllable-association pair in a 
prearranged sequence which was identical for all Ss. 
In this manner it was insured that six of the non- 
sense syllables were always indirectly associated with 
a comment of “normal” and the remaining six with 
“abnormal.” The procedure was then repeated “to 
make sure the interpretations were correctly re- 
corded.” Following this, the professor left the room 
and Recall Test 2 ensued, in which the S again 
wrote down all the nonsense syllables he could 
remember. The control group Ss were likewise given 
two verbal presentations of the syllable-association 
pairs followed by Recall Test 2. However, the pro- 
fessor was not present and no interpretations of as- 
sociations were made. Rather, the two Presentations 
were given under the pretext first, of making sure 
that the associations were correctly recorded and, in 
the case of the second Presentation, to ascertain 
whether the Ss were satisfied with these particular 
associations. Thus, for the experimental group, Ses- 
sion II consisted of two “incidental learning” trials, 
Personality threat indirectly associated with six of 
the twelve nonsense syllables, and Recall Test 2. 
For the control group, the procedure was essentially 
identical except that no threat was introduced. 
Session III. For the experimental Ss, Session III 
commenced with Recall Test 3. The psychology pro- 
fessor then entered and explained to the S in some 
detail that her interpretations of the day before were 
completely bogus, that the whole affair had been 
staged for experimental purposes to test the effect 
of stress on Performance, etc. In order both to 
ess and to provide 
each S was asked to com- 
the interpretations. About 
ed that the interpretations 
to them. The professed 
of the remaining Ss was 


interview. 

he control Ss were likewise given Recall Tests 3 

and 4, Separated, however, by an empty interval of 
approximately the Same duration as the experi- 
mental Ss’ interviews, ei 
Session IV. The 


» the design of 
> induction of 


edure except 
duced. 
Results and Discussion 
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Fig. 1. Nonsense syllable recall r 
(threatened) and control (nonthre: 


-d st 
changes in mean recall scores y 
cally significant #’s (p es 05) oi 
tailed test: (a) C group increas au Test 4 
recall from Recall Test 1 to a sé = fro i 
(b) E group decrease in “tota te ge 4 
Recall Test 1 to Recall Test 2; call Te, 
increase in “total” recall from eo in “Pe 
to Recall Test 4; (d) C group era ech TI 
mal” recall from Recall Test 1 to *% otal” "7 
2. The fact that the E group mean t 
call dropped significantly on 
whereas the corresponding , reas 
actually showed a significant C hreatind 
suggests that the hypothesized the si jfi 
repression did occur. Likewise, call i f, 
increase in E group “total” re of 2 re! 
Test 4 confirms the ng enerme r 
sion of repressive effects follow! that “of 


ab 
3.3% 
Sg et. 
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threat. It was therefore mnie osage 
experimental findings concur ressio” Pi qe 
Zeller, both with respect to “an 

and with respect to what has e | 
return of the repressed.” ; H 


or" 
sjon P 
The hypothesis that the rep "eneral u 
would be selective rather than 
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ae does not appear to be confirmed by 
val data. It is apparent from Figure 1 that 
Significant decrements in both “normal” 
abnormal” syllable recall contribute al- 
nae Fd to the significant “total” E 
cs €crease from Recall Test 1 to Recall 
chien, Similarly, the increase in E group 
call ie: recall from Recall Test 3 to Re- 
ing, ig st 4, although perhaps impressive look- 
sible E statistically significant. It is pos- 
general A repression tends to be selective or 
threat epending upon the extent to which 
“associated material is clearly articu- 
threat es material not associated with 
equivocal, Korner’s study, the threat was un- 
nd self y associated with certain discrete 
Kirsh ne stories and just as un- 
Stories Te 00t associated with other such 
irecth, n the present study threat was in- 
lables Y associated with certain nonsense syl- 
lables LS bai in a series of similar syl- 
iffcult rtas differentiation may have been 
fects fis €nce, the spread of repressive ef- 
With thr material not specifically associated 
ample ot in the present study may be an 
as “gener Nea Scheerer (3) has referred to 
alization by default.” 


The Summary 
Of 5 ent study investigated the effects 
duction and subsequent removal of 
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threat to personal adjustment on the recall of 
nonsense syllables, some of which were indi- 
rectly associated with the threat. The experi- 
mental results confirmed the hypotheses that 
threat would produce a decrement in recall 
analogous to defensive repression and that 
subsequent threat removal would cause a par- 
tial reminiscence of forgotten material akin 
to Freud’s “return of the repressed.” The hy- 
pothesis that threat would be selective rather 
than general in its effect upon recall was not 
confirmed. 
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Further Validation of the Ego-Strength Scale’ 


Robert D. Wirt? 


Veterans Administration Hospital, Minneapolis 


The Minnesota Multiphasic Personality In- 
ventory was administered to a population of 
hospitalized patients who had been treated by 
psychotherapy alone. These were scored for 
Barron’s Ego-Strength scale (1). The results 
confirmed, for a hospitalized sample, Barron’s 
findings for clinic samples: the Ego-Strength 
scale has good predictive power for response 
to psychotherapy, 

All patients admitted to the Minneapolis 
Veterans Administration Hospital during the 
period February 1, 1953, to February 1, 1954, 
routinely were administered the MMPI. of 
these 535 cases, the 225 in whom there were 
no organic complications and who did not 


receive physiological adjuncts to treatment 
were selected for stud 


without knowledge of 
tient was rated by his psychiatrist as Unim- 
Proved, Improved, or 
chief of the neurop 
acted as supervisor 


l 1 Payable to 
ervice, Library of Congress. 
y of Minnesota, 


or the 
by psychotherapy alone were selected © a 
sample. While only one item (No ae | 
nificantly separated the Gresy four items 
from the Unimproved patients, E in the d| 
(Nos. 95, 109, 355, 554) en py Barro 
rection opposite from that foun 7 ates at 
the scale as a whole separated the ee The 
better than the .05 level of proba 423 and 
mean raw score for the sample he was p% 
the standard deviation was 12.46. fable if 
sible to construct a conversion ie pa jent 
scores for use with hospitalized ES es 
No patient in the Unimprovet Er i 
ceeded the median of the ge score | 
Greatly Improved Group. If a Hy oint, hay 
value of 50 is used as the cutting Paa 1 PË | 
are no false positive predictions, 1 


jno? 
tients above this line were mpa excite 
the demand for pay chon to do r 
the supply of therapists availa aapi p 
chotherapy, this finding has cons! F 6 
ical importance. s th | 
“oe is ne that if on similar sample patien 
scale were used for selection, 50 chotherabg 
who would respond well to pa Oe lec y 
would not be chosen, but all ih show 
could accurately be predicted 
provement. 
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The Generality of the Prediction of Self Reports 
John J. Wittich* 


DePauw University 


y ae, "everse-testing technique as proposed 
one j rper (3, 4) is a procedure in which 
0 iota. is asked to simulate the answers 
ough €r on a preference-type inventory. Al- 
areas has use of the technique was to locate 
@0 indivian gs or of differences in 
Situation ual marriage or parental counseling 
Which gp Some work has been reported in 
tion co a utilized the cross administra- 
ae (1, 2). Since little or no study 
ability ¢ evoted to the generality of the 
Y to predict or to the correlates of “un- 


derst, . 
anding,” a preliminary study was made 


(5), 


Preliminary Study 


the limitations imposed by the pro- 
oe the purpose of the previous in- 
On was: (a) to determine the degree 
8S 9 the ability to predict the re- 
tory, (è) others on a preference-type inven- 
adjustm to ascertain the relationship of the 
te of one individual to his ability to 

de mi © responses of others, and (c) to 
Of a ae the relationship of the adjustment 
Medicteg to the success with which he is 


n th 
two acce Study, each of 106 students chose 


CAR 
n th Waintances to predict, item by item, 


With 


dieti Bell Adjustment Inventory. The pre- 
Mere k the students’ original responses 
ach R yield adjustment scores for 
Wo icting and predicted subject and 


e 
poes, Th Prediction or “understanding” 
© distri © results of the intercorrelations of 
ge N inene 5 are tabulated in Table 1. 
teq Partial correlations were also pre- 
the following conclusions were 


to Lis sg, 
al Ki 

i iy dissert 'S condensed from a section of a doc- 
eal The <o Submitted to Stanford University 
Stin by E a r appreciates the assistance af- 


Faculty, Humphreys, who was then on the 


1. There is evidence that the ability to predict the 
responses of others may be regarded as a trait. 

2. There is some evidence that the adjustment of 
the predictor is related to his ability to predict, but 
there is also evidence of an artifactual relationship. 

3. There is some evidence that the adjustment of 
the person predicted is related to the ease with 
which he can be predicted, but there is also evidence 
of an artifactual relationship, 


As a result of the preliminary study, the 
following suggestions for a future investiga- 
tion were made: (a) the design of the experi- 
ment should not provide for the students to 
choose acquaintances to predict; (b) the de- 
sign of the experiment should be such that 
the subjects will be required to predict sev- 
eral specific people with whom they have had 
time to become acquainted; and (c) the de- 
sign should eliminate items on the instrument 
used which lack face validity. The present 
study meets these requirements. 


The Problem 


The primary objectives of the present ex- 
periment are (a) to test generality with a 
number of prediction, or understanding, tasks; 
(b) to re-examine with a new design the re- 
lation between adjustment and understand- 
ing; and (c) to investigate the relation be- 
tween adjustment and the capacity to be un- 
derstood. 


Table 1 
Intercorrelations of Five Variables 

~(V = 106) 
Variables 2 3 4 5 
1. Total-Score-Student Al 230 e 220.4 7208. 
2. Student-for-A 48 44 16 
3. Student-for-B 04 46 
4, Total-Score-A 25 

5. Total-Score-B 


Note.—The standard error of an r of .00 is .09, 
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The Experiment 


Subjects. The subjects were 42 enlisted 
men in the United States Air Force who had 
Previously exhibited college-level ability on 
standardized batteries of tests. These subjects 
were not living together in barracks in the 
usual propinquity of military life, but they 
had been working together in closely-knit 
work units daily for at least four months. 
The range in age was from 19 to 33 years. 
These subjects were assigned to groups of six 
members each (within their own work units) 
and were required to predict and to be pre- 
dicted by the other five group members. 

Instrument. A revised and shortened Bell 
Adjustment Inventory was employed in this 
experiment since it was found that many 
items in the standard inventory, particularly 
those referring to health adjustment, were 
inappropriate for servicemen. The total num- 
ber of items retained was 100. 

Another important change entailed the 
elimination of the “p” as an alternative re- 
sponse. From the preliminary experiment it 
appeared that the effect of the “?” response 
for prediction may have been to increase the 
error involved. 

It should be expected that the reliability of 
this revised instrument will be lower than that 
of the standard inventory since the revision 
has fewer items, The analysis of variance to 
be described later in this experiment will in- 
dicate that minimum reliability was obtained, 
Directions. On the first day of the experi- 


1. The adjustment scores were o 


btained by 
comparing the typical scoring key 


of the re- 


Wittich 
vised inventory with the observed responses 
of the airmen on their self reports. _ edt 

2. The prediction scores were baie p 
comparing, item by item, the predici 
sponses with the self report of the p. 
subject. 


. e 
sis of th 
Treatment of the scores. An aia eiel 


A et: 5 
variance of the prediction scor B metho 


i lati 
of generality, but the corre } : 
was applied to explore the relationships a 
tween adjustment, ünderstanding, © Abita 
pacity to be understood. Three d! 


S 


were provided for statistical analysis: 


ai 
1. The adjustment scores were obt 
described above. a 
2. The understanding distribu ora 
tained by averaging the eee abject 
airman obtained as he predicted es 


d wae, 
3. The capacity to be understa. sredico 
h predi 


ned 35 


b- 
n was ° h 


tablished by averaging the _ 
scores which were obtained for e <r 
subject. This provided a distribu 
scores. 


of 


Results and Discussion 


=a Tal 
men dict. 

Generality of the ability to ea hich 
2 contains the variance age pur 

considered appropriate for the 
the investigation. a 
vi the varian 
It will be noted that mee 


don? pe 
; may id 
that the influence of the grouping cons! 


pose 


e betw g | 


: r 
eliminated from the F ratios ences to 
eration. The table is broken aY the wA 
following sources of eR E varianc? 
ance between predictors, (0) t ‘dual of in 
tween predictees, and (c) a TSU". thin 
action variance. The variance 


Table 2 


iz 
Variance Table for Scores Catear es 
Predictors and Predic 


ed in 


germ? of 
7 
aanl 
atit te 
aima 


Sums of f 
Sources squares J zit 
133° 
Between Groups pes 35 uwt 
Between Predictors RS 35 69 
Between Predictees 8, 39 13 13:35 
Residual (Interaction) 36 Sg 168 g0 
Within Predictors ea 
Within Predictees 8, 


Total 19,421 


168 
209 
0}: 
rpe ie 
4.61; P S00 
Predictor F ratio = 133.80/29.02 = 0°36: p 
Predictee F ratio = 242.63/29.02 = 
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Scores of predictors and the variance within 
the scores of predictees are also used. 

_In order to investigate the ability to pre- 
ae the variance between predictors was em- 
2 prer as the numerator and the residual or 
T ea variance was employed as the de- 
eran The resultant F ratio was signifi- 

beyond the .001 level. 

It is possible to express the magnitude of 
© generality of the ability to predict in more 
hie = frame of reference. Using the vari- 
‘es etween predictors and the residual vari- 
“a Sea the basis for computation, the aver- 
io be telation between predictors was found 
tiac 42. This coefficient, representing an 
Seren correlation, may be interpreted as 
which we the magnitude of the generality 
Predict weet be expected if all the predictors 
order + Subjects of equal predictability. In 
control. obtain generality of this magnitude, 
ee of the predicted subjects would be 
ary. 
a ms also legitimate in this situation to uti- 
ination Variance within predictors in com- 
ompute with variance between predictors to 
W: en H t average coefficient of generality. 
1s is done the coefficient is equal to 
Would ese results are of the magnitude which 
Tangemen expected if the experimental ar- 
pr sere were such that the predictors were 

edicting different subjects. 

hte of significance of the F ratios in- 

ictors at the variance of the scores by pre- 
chance a be regarded as the result of non- 
ability bs erences between predictors in the 
ability i Predict. There is generality in the 
hough É predict the responses of others, 
Rificance e amount is of little practical sig- 
The 3E unless there is control of predictees. 
Predictor average correlation of .42 between 
tion in dee under the more controlled condi- 
In icates that any assumptions concern- 
the ,..U2derstanding ability of a subject on 

ho of one or two predictions is subject 
€at error, 


n eee of the capacity to be predicted. 
dict to investigate the capacity to be pre- 
Vidyay, © Variance between predicted indi- 
Was used as the numerator and the 
Or interaction term as the denomi- 
yong e resultant F ratio was significant 
ter, the .001 level. When the variance 
Useg employed in the above F ratio were 


© express the average correlation be- 


Da 


447 


tween predictees, the coefficient of generality 
was .59. Since this coefficient was derived 
from the variance between predicted indi- 
viduals and the residual variance after the 
influence of group and predictor variance 
were removed, it is legitimate to interpret it 
as an expression of the expected results when 
all the predictees are predicted by predictors 
of the same ability to predict. 

When the variance within predictees was 
employed with the variance between pre- 
dictees to compute the average coefficient of 
generality, the resultant coefficient was .43. 

These results, like those which concern the 
generality of the ability to predict, must be 
interpreted only in the light of the amount 
of restriction placed on the variance esti- 
mates. There can be little doubt that there 
is some evidence for nonchance differences be- 
tween predictees in the capacity to be pre- 
dicted, regardless of the variances used in the 
computation. The average coefficients of .59 
and .43 indicate that the capacity to be pre- 
dicted may be considered a trait. 

Coefficients of correlation. Zero-order cor- 
relation coefficients with relation to the ad- 
justment, understanding, and understood dis- 
tributions were computed. 

A zero-order correlation coefficient of .11 
between the adjustment of the airman and 
his ability to understand others provides no 
evidence for a relation between adjustment 
and understanding. The correlation of .05 be- 
tween understanding and being understood 
indicates that understanding, whatever its na- 
ture, is independent both of the predictor’s 
adjustment and his capacity for being un- 
derstood. 

The correlation coefficient of .73 between 
the airmen’s adjustment scores and the mean 
of the understanding scores which group 
members attained using them as subjects, 
merits extended consideration. It would ap- 
pear from this coefficient that the better the 
adjustment of the predictee, the more easily 
he is understood. The viewpoint might be ad- 
vanced that the predictors tend to predict 
adjusted responses. Then, if the person for 
whom they are attempting to duplicate re- 
sponses is adjusted, the understood score will 
be high. If, however, the subject is malad- 
justed, the adjustment score will be low as 
will the level of understanding. However, an 
inspection of the distributions of prediction 
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scores, scored for adjustment, found the 
means of these distributions to be about the 
same as the means of the actual adjustment 
scores of the subjects. The scatter diagram 
of the adjustment-understood relationship 
showed that, while the great majority of 
deviations from a roughly estimated best-fit 
line were instances where the predictee was 
misunderstood and well adjusted, there were 
no instances where the predictee was well un- 
derstood and maladjusted. Support must be 
given, therefore, to a general thesis that the 
maladjusted are difficult to predict. The rea- 
son they are not understood is not because 
predictors refuse to predict maladjusted re- 
sponses. 

Another view of this finding may be found 
in the logical difference between predicting 
for an adjusted and a maladjusted individual. 
A predictor who believes he is predicting an 
adjusted subject marks the prediction report 
with the obvious adjusted answers. If he be- 
lieves his subject is maladjusted, he has the 
task of determining which of the areas are 
maladjusted, and which items represent those 
areas. This is evidently a difficult task. 


Conclusions 


All conclusions are made in the frame of 
reference of the present study. 

1. The ability to predict the responses of 
others may be regarded as a trait. 

2. The capacity to be predicted by others 
may be regarded as a trait. 

3. There is a Positive relationship between 


the adjustment of a subject and the success 
with which others understand him, 


Summary 


The primary objectives of the experiment 
are (a) to determine the degree of generality 
in the ability to Predict the res 
others on a preference- 
ascertain the relations 
of one individual to his abil; 


relationship of the adj 
the success with whi 
preliminary study had 
sity for an experimental design involving 
several prediction tasks for each subject. 


Wittich 


A revised and shortened Bell Adjust 
Inventory was employed as 42 subjes a 
ranged into six-man work groups, aby the 
quired to predict and to be predicte 


each 


: ing key: 
subject by utilizing the typical scoring 


Prediction scores were obtained b A 
ing, item by item, the predicted teoa i 
with the self report of the predicted 
These latter scores could be orea ea 
in terms of the predicted scores T o by the 
subject obtained for others, and rie others 
predicted scores that were obtaine 
for each subject. led that the 
An analysis of variance revea e more sub- 
capacity to be understood provides ae abil- 
stantial evidence for generality than evidenc? 
ity to understand, but that there 15 ad- 
for both. Intercorrelations bee to ul 
justment of the subjects, their abi a be 
derstand others, and their capac arked 1% 
understood resulted in only one ate adjust 
lationship, that between the p t a 
ment scores and the mean of the be attal 
ing scores which group ee 
using them as subjects. The t ndict A 
maladjusted are difficult to pre 
ported. Ain ete Paar 
It may be said in the srteyr tO 
the present study that (a) the abe reste 
dict the responses of others a predici) 
as a trait, (b) the capacity to ait and ( 
by others may be regarded as a zs : 
there is a positive relationship 


0 
ce 
f referen" re- 


etwee” ith 


: 4 ucce: 
adjustment of a subject and the 5 
which others understand him. 
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Empathy, Similarity, and Self-Satisfaction’ 


Howard M. Halpern 
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ean, ecent review by Taft (7) of studies 
ects aan the ability to judge people re- 
Petiment. current extensive interest and ex- 
as att tation in this area. One problem that 
ect of racted particular attention is the ef- 
ictee similarity between predictor and pre- 
on the accuracy of predictions. 
Mesta pene is not a new one. In their experi- 
Shas on personality judgment, Wolf 
ost a, (8) noted that subjects were 
hose ee in predicting about people 
their he ratings were most similar to 
Mations n and least accurate in making esti- 
Were leg Bis ut those whose average ratings 
that is T similar, They thus raised a problem 
Le veri utmost importance in the study of 
bette; P athic process. Do people empathize 
Ais others who are relatively similar 
Se ves? If so, what is the role played 
Urtay ction or attribution? * Wolf and 
tion dia Were inclined to believe that projec- 
Co not account for their result. They 
that m d, “The best explanation seems to be 
already « can only understand what he has 
ae ee One might hazard the 
NOt mak that without empathy a man can- 
e an accurate diagnosis and he can 


ing gill 
Study > ©XPeriment was part of a doctoral research 
k pape College, Columbia University (5). 
Rees seer ents are extended to the au- 
dwarg J ae committee, Professors Paul Eiserer, 
Qo Man of oe and Herbert Solomon. Dr. Gerald 
ttt and D e New York City Domestic Relations 
ae Riess Jacob Cohen, Chief, New York Train- 
sign ang citans Administration, aided with the 
agare mp tatistical treatment of the data. Dean 
as o Using Shay of the Adelphi College School 
Ubjects, Sraciously made her students available 
e 
nefere Ba attribution rather than projection is 
in ing of avoid confusion with the psychoanalytic 
Apiting of projection which refers only to the 
sej bution unconscious, unacceptable ideas to others. 
Ously op does not differentiate between con- 
unconsciously imputed characteristics. 


best empathize with those whose responses 
resemble his own” (8, p. 363). 

Bender and Hastorf (2) proposed an opera- 
tional deñnition of projection as the relation 
between a subject’s self-ratings and the rat- 
ings he attributes to others. From this they 
developed what they called a “refined empathy 
score” (3) by subtracting a subject’s projec- 
tion score from his total predictive accuracy. 
They felt that this refined score was a better 
measure of the subject’s empathic ability. 
They noted also that while the raw empathy 
score correlated significantly with similarity, 
the refined score did not. Nevertheless, they 
found cause for dissatisfaction with their 
method of attempting to tease out projection 
(or attribution) from over-all predictive ac- 
curacy. They stated, “We suggest the need 
for a methodology for differentiating between 
projection and empathy in these prediction 
tasks. The next step would seem to be to ob- 
tain predictions from individuals for a num- 
ber of their associates; these associates should 
differ in the amount of their similarity with 
the predictor. These data could be used to 
determine more closely the relationship be- 
tween similarity, projection, and empathy” 
(6, p. 576). 

One major aim of this study is the ex- 
ploration of the relationship between simi- 
larity and empathy. 

A second area of concern is the determina- 
tion of the relationship between a person’s 
self-satisfaction or self-dissatisfaction in a 
given personality area and his ability to pre- 
dict accurately in that area. 


Procedure 
Subjects 


The subjects were 38 female student nurses 
at the Adelphi College School of Nursing. For 


449 


450 


at least two years they had been in close as- 
sociation with the other members of their 
group in a variety of academic, social, and 
professional situations. The college faculty, 
employing sociometric methods, had divided 
the students into four “maximally harmoni- 


ous” groups. Each group served a different 
hospital unit. 


Instrument 


With the aid of judges and a priori criteria, 
an instrument was devised consisting of 80 
items from the Guilford-Martin Inventory of 
Factors GAMIN (4) ° that were considered 
most suitable for use in a predictive empathy 


test. An equal number of items was selected 
from each of the five factors. 


Two further changes of the GAMIN in- 
ventory were made, one by omission and one 
by addition. The opportunity to respond to an 
item with a question mark, if a “Yes” or “No” 
answer could not easily be given, was elimi- 
nated, thus forcing the subjects to respond 
dichotomously. The second change involved 
asking the subjects to indicate whether they 
were “Pleased” or “Dissatisfied” with them- 


selves in the personality area tapped by each 
item by encircling a “P” or a “D” after 
answering the item. 


Administration 


Each grou 


session the subjects were asked to rate them- 


MIN inventory. Be- 


her group was determined by tabul 
number of “Yes” or “No” 


answered in the same way, 
group members most Similar 


ating the 
items that they 
Then, the two 
and most Dis- 


3 (G) general Pressure for oy 
ascendency as opposed to submis 
linity as opposed to femininity i 
terests, (I) inferiority feelings, 
tendencies. 


ert activity, (A) 
sion, (M) mascu- 
n attitudes and in- 
and (N) neurotic 
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Hypotheses 


c 
1. Subjects predict with greater anti | 
about predictees who are similar to the 


about those who are dissimilar to age 
2. Subjects predict with greater a ave 
on concordant items (items which they ae 
answered in the same way as their pre E i 
than on nonconcordant items pera i 
they have answered differently fro 
redictees). s reae 
2 3. On h i items there is i 
accuracy in the predictions made me 
lar referents than dissimilar referen 2 
4. Ability to predict accurately ie 
concordant items correlates positiv 
-all predictive accuracy. 
v rAr where subjects Eo 
that they are dissatisfied with ne 2 
ings they do not predict as accural 5y they 
items where they have indicate 
are pleased. 


indicate? 
prat 
sel D 


y 


Results 


sgg th 
jctions 
1. A ¢ ratio indicated that aoe a ie 
Similar referents were more cee i fica 
Dissimilar referents at a level “a subjecti, 
beyond .001 (¢ was 4.25 for 5 e 
Furthermore, a highly siguien when ne) 
38 subjects were better predic - those we 
ting themselves in the place o scores 
resembled. When mean similarity 


gni 

ab DA 

ubjec” gye 

average number of items each 5U- er fi 


swered in concordance with eh a 
referents on the self-ratings) We? - „ye 
with mean predictive accuracy nae 
number of correct predictions the res 
made about her five referents) tbe 
r was a significant .84. , 

2. The second hypothesi racy | 
subjects predict with greater acc dant Í 
cordant items than on nonconco yp 
A ¢ ratio of 12.81 supported age pject® fof 

3. On nonconcordant one 
not predict significantly more dictees 
Similar than for Dissimilar pre 
1.19). 

4. A nonsignificant comelo iy d 
found between a subject’s — an 
accurately on nonconcordant 1 d po! y 
over-all predictive ability. ;ndicat®? y o 

5. The results of a ¢ test : ac i 
subjects predicted with greate 


0 
jon “a pre pë 
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“Pleased” items than “Dissatisfied” items at 
beyond the .001 level of significance.* 


Discussion 


The data reflect a clear positive relation- 
ship between an individual’s similarity to an 
acquaintance and his ability to make accurate 
Predictions about him. Furthermore, predic- 
tive accuracy is greater when the individuals 
involved resemble each other in the specific 
areas of prediction than when they differ. 


Empathy or Attribution? 


ma accounts for this ability of indi- 
is ee to prognosticate better about Similar 
5 maa to Dissimilar people and within 
Baat rather than unshared areas of per- 
ie a Empathy has been operationally de- 
Sia mM terms of predictive accuracy, but it 
hs aan that the above result could be a 
rait lon of the attribution of a subject’s own 
S to others rather than genuine sensitivity. 
» m nonconcordant areas, the subjects 
Predicted more efficiently about Similar 
er than Dissimilar acquaintances this 
ter accuracy could only be a function of 
daa sitivity to similar people. In unshared 
ref bution can lead only to error and 
acilitaty could have been ruled out as a 
Such Or of more accurate prediction. — 
Predict Was not the case. Subjects did not 
Dose tee catitly better for Similar as op- 
Shareq © Dissimilar referents in these un- 
tive Rs ae The increased over-all predic- 
ility found to exist when the predictor 
the are tietee were similar was confined to 
these foe of their similarity. Once outside 
Just ag ncordant areas the predictors were 
blance k at sea when their total resem- 
as when» their referent was relatively great 
ecan at was minimal. 
with eed a person’s ability to empathize 
boy ara people lies strictly within the 
utside es of their similarity and disappears 
first ¢ Of these boundaries it might seem, at 
must 3 2NCe, that an attributive mechanism 
an at work. This is not necessarily so. 


haq 
rath 
Brea 
true 


ta; The 
sed fromplete data of this study may be ob- 
teet, m University Microfilms, 313 No. First 


, 

A 

xe, Soa Arbor, Michigan. Refer to H. M. Hal- 
s 8677, factors involved in empathy, Publication 
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What may instead be indicated is that people 
cannot effectively predict about what they have 
not phenomenologically experienced. The close 
relationship between similarity and predictive 
skill might simply mean that there is a greater 
likelihood that a person would recognize 
feelings and patterns of behavior in others 
if he has known similar feelings and patterns 
of behavior in himself. When an individual is 
confronted with the emotions and actions of 
another person that are alien to his own ex- 
perience, accurate recognition, and hence, ac- 
curate prediction, is little better than a chance 
matter. 

The degree of similarity between two peo- 
ple may therefore reflect the overlapping of 
their capacities to empathize with each other. 
The rationale for the finding that even two 
grossly similar people cannot predict at better 
than chance accuracy in the few areas of dis- 
similarity would then be that they were at- 
tempting to empathize where little capacity 
for empathy existed. 

Although the equation of similarity with 
capacity for empathy has rarely been so 
pointedly suggested by experimentation, it is 
not a new idea. In 1928 Adams wrote: 


. any experience or mental process in another 
organism can be inferred from structure, situation, 
history and behavior only when a similar experi- 
ence or mental process is or has been invariably as- 
sociated with similar structure, situation, history and 
behavior in oneself; and the probability of the in- 
ference will be proportional to the degree of simi- 
larity (1, p. 252). 


Two alternative concepts, therefore, still 
remain as possibilities in explaining the find- 
ing that the greater predictive ability for 
similar people is restricted to the areas of 
their similarity. Either the concordant areas 
represent the presence of a capacity for mutual 
empathy, or are simply areas where attribu- 
tion will inevitably get good results. The 
methodology of this study has failed to dif- 
ferentiate the relative weight of these two 
factors. 

When the subjects’ ability to predict ac- 
curately on nonconcordant items was com- 
pared with their over-all predictive accuracy, 
no relationship was found. The question 
arises, which is the truer measure of empathy? 
Is it the ability to feel most extensively into 
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the largest number of people, or the ability 
to feel into those characteristics of others that 
differ from one’s own? 

Both arguments can be persuasive. It must 
certainly be granted that a measure which 
clearly eliminates attribution seems closer to 
the spirit of the term empathy. Yet, as we 
have seen, because a person accurately enters 
into the frame of reference of a similar person 
we cannot assume attribution nor rule out 
empathic sensitivity. Further, it would seem 
to be doing just as great an injustice to the 
meaning of the term empathy to designate as 
good empathizers people who cannot feel 
extensively into the phenomenological field of 
others but who can somehow predict about 


them relatively better in areas where they 
differ. 


Empathy and Self-Satisfaction 


The subjects predicted with significantly 
greater accuracy on items where they had 
indicated self-satisfaction rather than dis- 
satisfaction. One possible rationale for this 
finding is that in areas where a person is dis- 
content about his own behavior, disorganizing 
anxiety may be aroused and distortive de- 
fenses may be mobilized, Both of these factors 


may function to cause aberrations in accurate 
interpersonal perceptions, 


Who Is the Good Empathizer? 


particularly if 
€asure of the 
the situation, 


to encompass, 
c scope. 

-satisfaction 
on who is at 
vior is likely 
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re 
to be a better empathizer than those who 4 
largely dissatisfied with themselves. 


Summary 


a Mirr 
The ability of 38 student nurses, 2 E 
groups, to predict each other’s pin 5 
personality inventory was determi “scant 
ability, which served as an operationa sitivel 
tion of empathy, was found to be POP rictor 
correlated with (@) the similarity of r ie 
and predictee, and (b) the predicto arena 
faction with her own behavior in the 
rediction. Jed t0 
i The methodology of this study foie ore 
resolve whether the ability to Proci product 
accurately for similar predictees was 4 P revet 
of attribution or true sensitivi similarity 
it is proposed that the factor 0 redictiv® 
may not be an artifact of the ie g 
method, as other experimenters ita 
gested, but that similarity may be z 
of the empathic process. It maa ai 
people can most readily se gerge 
what they have experienced, On 
in themselves. 
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Cultural Symbolism: A Validity Study 


Emanuel Starer 


Svat (1) reported that the results of his 
ih ment with 62 normal children in the 
the ae of a public school did not support 
= Ypothesis that: “... certain environ- 
E =e objects by virtue of their structural 
olic pepe may be taken as being sym 
B45), he male and female genitalia” (1, 
sin Purpose of the present study is to in- 
i Tr this same hypothesis that “where 
means objects are categorized by a given 

ich kis either male or female, those objects 
or an ad be described as elongated, pointed, 
objects ar will be categorized as male; those 
ieee may be described as round and 
emale” G in = will be categorized as 

»~p. à 


Method 


a $ os hs this experiment consisted of 64 
hotiç z chotic patients and 48 female psy- 
sion Patients in varying degrees of remis- 
> -0e age range of the Ss in the male 
piati nd female group was 20-48 and 24- 
98 Der Pectively, The primary diagnosis in 
Schizop ans) of the psychotic population was 
Sistine S reaction. Another population 
age of 19 of 30 student nurses with a mean 
Wag 4124 considered to be clinically nor- 

a S also tested. 
tainin A were presented with ten cards con- 
dom pa gures which were presented in ran- 
or A Five of the figures were elongated 
of €d and were assumed to be symbolic 
characteristics, Five figures were 
è and containing and symbolic of fe- 
Contain atacteristicst Ten additional cards 
Thomas S the names of five males (Jack, 
“males ae James, and Harry) and five 
Were given > Betty, Irene, Sally, Barbara) 
tran en to each subject. These were also 
Gane n a randomized manner. Each sub- 
fron Opies of 
the ady 


Ve 


group a 


the figures are available on request 
or, 


Veterans Administration Hospital, Coatesville, Pa. 


ject was seen individually for approximately 
ten minutes and was told to “place the names 
of these five men and women on these cards 
(containing the 5 male and 5 female figures) 
wherever you feel they belong.” After this 
was done and the results recorded, the Ss 
were asked to tell the examiner what each 
figure looked like to them. 


Results 


As in Levy’s experiment the presented task 
requests a simple sorting problem. By calcu- 
lating the expected probability of getting any 
given number of “correct” sorts and compar- 
ing it with the obtained frequencies by means 


Table 1 


Predicted and Observed Frequency Distributions for 
Any Given Number of Correct Matches in the 
Male Psychotic Population (N = 64) 


Number of ‘ 
correct Predicted Observed , 
matches p frequency frequency 

co a aMMa 

0 .001 .06 0 
2 10 6.40 1 
4 39 24.96 13 
6 39 24.96 18 
8 10 6.40 23 
10 001 .06 9 
a 
Table 2 


Predicted and Observed Frequency Distributions for 
Any Given Number of Correct Matches in the 
Female Psychotic Population (N = 48) 


Number of 


correct Predicted Observed 
matches p frequency frequency 
n_i 

0 001 0S 0 

2 10 4.80 0 

4 39 18.72 5 

6 39 18.72 21 

8 10 4.80 17 

10 001 .05 5 


453 


454 


Table 3 


Predicted and Observed Frequency Distributions for 
Any Given Number of Correct Matches in the 
Student Nurse Population (V = 30) 


f 

Pe Predicted Observed 
matches p frequency frequency 

0 001 03 0 

2 10 3.00 1 

4 39 11.70 2 

6 39 11.70 8 

8 10 3.00 9 

10 001 03 10 


of chi square, it is possible to test the null 
hypothesis. The results are presented in 
Tables 1, 2, and 3. 

The chi square for Table 1 is 113.17 with 
three degrees of freedom. The result is sig- 
nificant beyond the .001 level of significance. 
Chi square for Table 2 with three degrees of 
freedom is 75.78 and is significant beyond 
the .001 level of significance. Chi square for 
Table 3 with three degrees of freedom is 
94.73. This result is significant beyond the 
-001 level of significance. 

Table 4 contains the most frequent asso- 
ciations to the presented figures given by the 
three groups of subjects. 


Discussion 


The results of this experiment are contrary 
to that obtained by Levy. It is possible that 


Table 4 

Most Frequent Association: 
in the Male and Femal 

and Student N 


s to the Presented Figures 
e Psychotic Population 
urse Population 


Figure Association 


Pencil, bullet 
Lips, mouth 
P Gun stock, or rifle 
ide view of a canoe, stick, branch, belt 
en, pencil 
Hat, bowl 
Hills, mountains, letter « 
Bowl, cup 
Cigarette 
or frame, letter ae? 


m” 


OLOSAN 


= 


i . 
Circular form ine 


*In calculating x°, the two extreme categories at 
either end were combined because of the low pre- 
dicted frequencies, 


Emanuel Starer 


ined 

some of the discrepancy may be ona 
on the basis that distinct differences ie ie 
the type of subject population. Age aa 
present experiment, a different set i , 
was employed. However, inspectio they at? 
two sets of stimuli suggests et ae 
substantially similar. Another ape al- 
possibility that Levy used group + from H 
though this is not absolutely clea vias use 
report, and only individual testing 
in the present experiment. , oft 

Before we can dismiss the pi im 
cultural sexual symbolism, more Se resi 
vestigation is needed. Certainly, © e strons 
of the present experiment point henomendh 
possibility that there is such a ily accept 
as a symbolism which is genera 2 
in any particular culture. the €% 

An ineresting observation mède ae p 
aminer, although statistical pro? tients w 
yet be presented, was that the P d disorgan 
were relatively more confused gn atchi" 
ized made many more amors, i airly gon 
than the patients who seemed i sie as 
states of remission. The — illness y 
the possibility that one a a os 
the fact that there never ape the very dh 
plete acceptance on the part 0 1 prevail! a 
turbed patient of the general Another ae. 
symbolism in a given nag regressio a 
sibility is that there has been a level bie 
a result of emotional illness to ‘et P ay i 
cultural symbolism does oe This 
effective role for the persona ta eation 
pears to warrant further investo 


Summary y 


sani 

sq tion y 
investiga" m 
The results of the present aor ther wut? 


»pothesi: ul 
pear to support = ae particular A a 
08 
y. THe arte 


to and acceP 


individuals to adapt distu 


. j na 
symbolism results in emotio 
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Temporal Acuity of Vision, Audition, and Touch 
in Psychogenic and Neurogenic Pathology’ 


Albert F. Ax 


University of Washington 


and William H. Colley 


VA Mental Hygiene Clinic, Huntington, West Virginia 


oe fusion frequency, as Geldard (6, 
Ure of i ela may be considered as a meas- 
acuity js a temporal acuity.” Temporal 
iscrete sti e ability to resolve two or more 
ime, As me appearing close together in 
ting stim i time is decreased between recur- 
Teached a the critical frequency is finally 
eir diser which the separate stimuli lose 
Portable pes with a noticeable and re- 
tio on. ange in the quality of the sensa- 
hat ey stimuli at frequencies above 
a stead icker fusion point, the sensation 
there is y light. Below the CFF frequency 
Studies ga Sensation of flicker. The many 
ave an te temporal acuity (CFF) 
errijp (8 y been reviewed by Hecht and 
(14); (8) and by Simonson and Brozek 


Te 
as A oa acuity for other sense modalities 
“Ussing peen so extensively studied. In dis- 
the Dhe auditory flutter,’ Geldard reports 
Visual tii not to be comparable to 
tonal a flicker fusion, since “if the 
fusion He! is really effective the ‘critical 
go Sense fa is never reached . . . [it] is in 
und in he ‘fused’ continuity of the kind 
of ficke Vision above the critical frequency 
Context r (6, p. 137). It is clear, from the 
e iik eldard is oriented in this discussion 
tal p iit ure of the sensation above the criti- 
Petsisten as related to problems of neural 
OE e eiñ Ce. If, on the other hand, the aspect 
tro Poral acuity” is considered, the in- 
co ashing’ Department of Psychiatry, University 
Agn. Ston School of Medicine and the Veter- 


Mini = 
istration Hospital, Seattle, Washington. 


the cri 


vestigation can be focused on whether sub- 
jects can consistently report the point at 
which the sensation of separate stimuli is 
lost (with rising frequency), or when the 
sensation of discreteness reappears with de- 
creasing frequency. 

Temporal acuity of the skin to tactual and 
electric stimuli has been largely neglected in 
the long discussions of the “vibratory sense” 
which Geldard (5) has thoroughly reviewed. 
He does, however, report a few findings on 
the lower frequency limit for the “vibratory 
sense,” that is, the lowest frequency at which 
separate impacts are felt as a “vibration” or 
separate shocks as a “tingle.” Knudsen (10) 
found the lower limit to be from 12.5 to 
18.00 per second for shocks with an average 
of 15.3 for two observers. Kampik (9) and 
Brecher (4) believed it to be 16 cycles per 
second for tactual impacts. 

These studies indicate that temporal acuity 
for the tactual sense can be identified. It is 
clearly recognized, however, that as with the 
auditory temporal acuity, when the stimulus 
frequency is above the critical value, the ex- 
perience is quite different from the smooth, 
continuous sensation of the steady-appearing 
light when above the CFF frequency. 

Since the various sense modalities produce 
a variety of experiences when stimulated at 
frequencies above the temporal acuity thresh- 
old, it is essential to define the temporal 
acuity threshold by the uniform referent of 
“Joss of discreteness.” Seeing, hearing, or feel- 
ing separate, discrete stimuli is a general 
experience, not dependent on the particular 
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sense modality. Accordingly, in this experi- 
ment the temporal acuity threshold is defined 
as the mean frequency at which the experi- 
ence of discreteness is lost with increasing 
frequencies and reappears with decreasing 
frequencies. 

Critical fusion frequency of vision (CFF) 
has repeatedly been found to be lower in 
various pathological conditions of the central 
nervous system produced by toxins, anoxia, 
and physical damage to neural tissue. Bat- 
tersby, Bender, and Teuber (2) recently re- 
ported on a study of CFF in patients with 
long-standing lesions of either the frontal or 
occipital lobes. On the basis of their findings, 
they concluded that transient depressions in 
visual FF may occur after frontal lobe le- 
sions, but that injuries to higher visual path- 
ways are necessary to produce a lasting re- 
duction in CFF. They further hypothesized 
that transient reductions of CFF might ap- 
pear after cortical ablation of other nonvisual 
areas involving, for example, the temporal or 
parietal lobes, 

If this view is correct, the usefulness of 
visual CFF alone, as a device for localizing 
brain pathology, would be limited to state- 
ments of the absence or presence of an acute 
or new pathology of unknown position in the 
cortex, or the presence of an old lesion in 
higher visual pathways. In any given pa- 
tient, which of these is the case could hardly 


be specified with much confidence on the ba- 
sis of visual CFF 


Pression and 


1 ation of patholo whil 
it is still new or in an acute phase. aie 


Halstead (7) has Suggested a central 
mechanism of the cortex which limits the re- 
solving power of the primate visual system, 
On the other hand, there is the Possibility 
that each of the senses has its own integrat- 
ing mechanism or center governing its tem- 


William H. Colley 


poral resolving power which would pena m 
temporal acuity of the various senses Saf 
independent of each other, so long as iologi- 
are not disruptive of the general physi e 
cal economy of the total cortex. Where W: 
or acute disturbance affects the total a de- 
temporal acuity of all modalities may aan 
pressed, giving the appearance of a cet 
fusion mechanism. 

The present investigation seeks to 
mine, first, whether temporal apo 
reliably measured for auditory an oe i 
sense modalities and secondly, whe il 
extension to other sense modalities ate 
vide an increase in power for the Oe ind 
and localization of brain pathology: anis® 
question as to whether the fusion E a whole 
is a general function of the cortex modality 
or whether it is specific to the mea e 
will be explored, but it is un! 
clearly answered by this study. 


Subjects he vel 


All subjects were male patients at wash 
erans Administration Hospital, sa npon 5 
ington. Acceptability was panne ing ant 
ing ambulatory, capable of unders minig hos 
following instructions, and ee if med! 
pitalized for a period permitting c# 
cal evaluation. 

The neuropathology g 
patients. The criteria for neuropé 


a 

al 

ops . : abnorm 
positive neurological signs, : post A 


encephalograms and, where avale ble ed 
X ray and neurosurgeons’ Apor ect 
implied above, the subjects wet logy: Fal 
as to extent or location of peoa ee 
diagnoses revealed three patients lobe 1s? 
lobe lesions, two with parietal one W! 
two with temporal lobe lesions, 
cerebellar lesion, three with ae 
sions, and eight with pene ots 
pathology. Of the remaining oral, f 
were found in the occipital, Tempore on 
parietal lobes of one, in the dis et: 
frontal lobes of the second, an! third. ing 
poral and occipital lobes of the were Pe 
convulsant and/or sedative case the 
administered to 10 of the eet io 
of testing. Ages ranged from 2 
with a mean age of 40.4 years- 
lar accident patients, by virtue 


peortic® esl 


i ly Ing 
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erally higher age and ease of diagnosis, were 
eliminated from consideration. 

The Psychopathology group of 21 consisted 
of five patients initially suspected, but not 
Subsequently diagnosed as having brain pa- 
foe’? and 16 patients not suspected or 
Ae to have neuropathology during their 
; cal evaluation. Selected at random from 

© Psychiatric wards, 11 were classified as 
ay eoneurotics (three conversion reactions 
oo other or mixed subtypes), seven as 
i (two psychotic depressions and five 
aM oe reactions), and three as char- 
fed lsorders. Anticonvulsant and/or seda- 
the rugs were being administered to four of 
to ge OUP when tested. Ages ranged from 25 

years, with a mean age of 37.7 years. 


T Apparatus 
a A intermittent stimuli were produced by 
equip eral Radio Strobotac (type 631-B) 
fea with amplifier, speaker, tactual 

wo ein and neon tube. This oscillator had 
Èr Sec Se frequency ranges of 10 to 60 cycles 
€Yceles ond for the low range, and 40 to 420 
For a Second for the high range. 

e wa € visual stimuli, a type NE 40 neon 
ut a Plugged directly into the “strobolux” 
Voltage jack, which provided a brief, high 
duration ws of less than 30 microseconds’ 
xcept fo The NE 40 tube was painted black 
Vey a OY a 4-inch circular window directly 


r 
throu F glow plate. The tube was viewed 
Source pat light-tight black box, the light 
yes, NE 40 inches from the subject’s 


T 

Sty} iN eal Stimuli were produced by a bamboo 
Iistay) Projecting vertically through an ad- 
tac o Washer mounted on a horizontal sur- 
test pi, ‘venient height for the subject to 
"ela w and. The stylus was operated by a 
Millim ned to have approximately one 
pula a Stroke. Since the touch vibrator 
Maskin t be made completely noiseless, a 
Sound was produced (during touch 
om the 60-cycle hum through earphones 
Sy AC, Th S-a.c. heater supply of the Stro- 
( R i, hole in the washer on which the 
“boy Por his finger was very small 
n Jar Ch in diameter) which prevented 
“Men a Variations in finger pressure to 

"impede the stroke of the stylus. 


ay 
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In all cases, the stylus was felt to continue to 
vibrate at all frequencies used. 

Auditory and electric stimuli were provided 
by a condensor-coupled cathode follower am- 
plifier. The rectified output of this amplifier 
was switched either to a 3-inch speaker via a 
25,000-ohm output transformer, or to two ł- 
inch silver electrodes attached to the volar 
surfaces of two fingers on one hand with elec- 
trode jelly and tape. The sound produced was 
a clean-cut “tick.” The shock was also a 
clean-cut, discrete “jolt.” A volume control 
provided an intensity range from below 
threshold to an intensity well above threshold 
for all subjects for both auditory and shock 
stimulation. 

Procedure 

The temporal acuity thresholds for the four 
types of stimulation were determined in the 
following order: (a) vision, (b) audition, 
(c) touch, and (d) electric. Twenty alternate 
up and down trials were given for each 
modality. 

The first starting frequency was 10 cycles 
per second and thereafter randomly varied 
from 10 to 20 cycles per second above and 
below the previous threshold. Rate of change 
was one cycle per second per second. 

Instructions were similar for all tests. For 
example, the auditory temporal acuity thresh- 
old (ATA) instructions were: “Can you hear 
this ticking sound? You can hear each tick 
separately, but as I speed it up they will 
reach a rate so fast you cannot hear the 
separate ticks, but rather, the sound will be- 
come a hum or buzz. Say ‘now’ when you 
lose track of the separate ticks.” (The E 
demonstrated.) “Now as I slow it down, the 
separate ticks will come back. Tell me when 
you hear the separate ticks again.” 

The instructions for visual (VTA), touch 
(TTA), and electric (ETA) temporal acuity 
frequency thresholds were similar. In all cases 
the disappearance and reappearance of the 
intermittent aspect of the phenomenon were 
indicated as the focus of attention, although 
the natures of the sensations produced by 
frequencies above the thresholds were named, 
such as hum or buzz for audition, vibration 
for touch, and “tingle” for electric. The shock 
current was set at 1.5 times the mean of three 
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Table 1 
Temporal Acuity Values for Four Stimulus Modalities 
Average of Up Plus Down Trials l 
Vision Audition Touch _ eS 
7 z A x Sf 
Group xX S2 x SZ x S2 x ae 
33.73 “ 
PP 31.30 21.51 68.63 1,041.33 34.62 31.29 48.71 
NP 28.59 20.88 53.56 853.19 32.20 78.14 ee 
Diff. 2.71 15.07 2.42 = . 1.65 
F y 
t 2.73 2.27 1.08 zo 10 
Prob. <.01 <.05 >.10 .02 <. 
ity 
i ral acut! 
rising threshold determinations. Because of of 22. The mean on visual tempo 


sensory adaption or rising resistance, it was 
found necessary to redetermine the threshold 
every fifth trial. Most subjects reported this 
shock intensity of 150 per cent of threshold 
to be clearly perceptible, but not uncom- 
fortable. 

Except for the shocks, the stimuli were set 
at a constant intensity, as is customary in 
CFF studies. It seems likely that greater 
reliability of temporal acuity measurement 
could be made if the stimulus intensity were 


adjusted to some standard decibel level above 
the subject’s threshold. 


Results 


The customary score for flicker fusion is the 
mean frequency for the up and down trials 
averaged together. In Table 1 these scores 
are tabulated for each of the four stimulus 
modalities. On the first line are the means 
and variances (computed with N-1) for the 
psychopathology (PP) group of 21, and just 
below, for the neuropathology (NP) group 


Table 2 


Errors of Habituation for Four Stimulus Modalities 
Average of Up Minus Down Trials 


is 
(VTA) for the psychopathology goa 
31.30, and for the neuropathology Jiffer- 
28.59 cycles per second. The averag value 
ence of 2.71 cycles per second has @ ihan 1 
of 2.73 and a null probability of less itor 
per cent. In the next column rare nce } 
temporal acuity (ATA), the œ! at the 
15.07 cycles per second, but Jape cance 
extremely large variances, the null rs = cent: 
level falls between 1 per cent and a eg not 
The touch temporal acuity (TTA) althous 
differ significantly for the two groups, tholog) 
the mean is lower for the ae e for 
group. The variance is 2.5 tiren oni at o 
this group, with an F ratio sign! “i tempo” 
2 per cent level. The mean eee rol? 
acuity (ETA) for the neuropatho difiere" e 
is 2.79 cycles per second lower, a agait Ei 
significant at the .05 level. Here the P tho” 
variance is considerably larger for is t 8 
ogy group although the F ratio 
nificant. 


i 
dow 
ni 
In order to check whether the up ® 


Vision 


Electric 
Audition Touch aaa 

X on = Ed 
= = a x Sa x Sf 2 2147 
PP —1.55 3.64 13. : a 
Di 3 aag 1733 $90.01 ae aa 4.12 : 
Diff. —1.68 eine 6.89 Be e 
F e 
t 3.80 ap n m : vf 
Prob <.01 >.10 <01 <.0 
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Table 3 
Average of Up Trials 

Vision Audition Touch Electric 
Group =X s2 Se gg ss 3 x ss È se se 
PP = 
NP 30.52 19.72 1.20 75.36 1,644.82 110.95 35.17 34.71 13.30 34.84 27.21 15.89 
Dif 28.66 16.40 1.57 62.32 1,443.35 383.45 35.65 95.45 20.75 33.00 63.20 30.70 
pe 1.86 13.04 —.52 84 
= 2.76 2.33 
P -l 1.54 .27 61 
Tob, <.05 <.10 >.10 05 >.10 .05 


tri ‘i 
te x might be contributing differentially to 
trials a differences, the up and down 
ables op averaged separately and posted in 
apparent and 4, respectively. It is immediately 
most of that the down trials are contributing 
means the difference, since the down trial 
Patholone significantly lower for the neuro- 
ah ise group in all stimulus modalities 
signifies, the up trials. Only the VTA has a 
i E difference on the up trials at the 
hes r to isolate this factor which is 
Ove e to the down trials over and 
Measured | temporal acuity level itself, as 
th, uted by the mean of the ups plus downs, 
erences were taken between the ups 
a which are listed in Table 2. All 
s ion are heavily loaded with what may 
Se rae as an “overshoot” factor. This 
sens tendency has been described by 
ee (15) as “error of habituation,” 
tion» Negative, as the “error of expecta- 
“ove e neuropathology group tends to 
t” their temporal acuity level; that 


« 


. Vershog 


t s 
2 EY go higher on the up trials and lower 


on the down trials. In the visual modality the 
psychogenic group has a mean “error of 
expectation” of —1.55 while the neurogenic 
group has an almost zero mean error of .13. 
Each subject’s individual variances from 
trial to trial are tabulated in the columns of 
Tables 3 and 4 headed as “S,? with the up 
and down trials separate. With one exception, 
that is, the auditory down trials, these indi- 
vidual variability scores average higher for 
the neuropathology group. However, the vari- 
ability scores themselves have such large vari- 
ances in both groups as to make the ¢ tests 
of the differences between groups not sig- 


nificant. 

The correlations in Table 5 show an in- 
teresting trend. On the measures of temporal 
acuity, the neuropathology group have very 
small correlations between the four modalities, 
all being insignificant except that between 
touch and electric. This high correlation be- 
tween the touch and electric stimulus mo- 
dalities suggests these two modalities ap- 
parently involve the same sensory projection 
areas. In contrast to the low average inter- 


Table 4 
Average of Down Trials 
Vision Audition Touch Electric 

Gr, = 
=e X sa sè x S2 S? Žž Se S# X¥ SF S; 
Np 3207 2720 141 61.89 1,130.32 106.64 34.06 55.52 16.19 33.63 41.64 19.50 
Dif 28.53 2726 175 44.79 563.66 79.13 28.76 90.60 22.53 28.88 59.39 29.46 
P` 3.54 17.10 5.30 4.75 
$ 2.00 
Prob 3.15 2.72 2.88 3.10 

<.01 <.01 -06 <.01 <.01 
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Table 5 re 
Intercorrelations* Between Temporal Acuity Measures of Four Stimulus Modalities 
Combined P 
groups 
Psychopathology Neuropathology N=% 
N=21 N= 22 = 
Š Down 
Variables U+D U-D Up Down U+D U-D Up Down re 
5 5 09 8 
56 28 56 5S 00 31 01 3 
M T 57 32 57 53 09 56 09 5 35 
VE 55 15 75 46 02 49 og ji 46 i 
AT 57 54 54 60 26 76 42 37 50 
AE 57 47 55 56 41 44 51 67 14 
TE 75 85 75 78 55 85 56 f 
29 
Mean r 60 48 63 59 24 60 28 29 
(via 2’) 
* Decimal points omitted. ticon- 
ntl 
A atives or aM’ are 
correlation of .24 for the neuropathology Finally, the effect of T patients i 
group, the TA modalities are well correlated vulsants, which some o F f 
for the psychopathology group averaging .60. 
Psychop gy group, 8 


This finding of contrasting intercorrelations 
for the two groups suggests the possibility 
that specificity of the brain lesion is revealed 
by specificity of temporal acuity in that 
sensory modality mediated by the particular 
brain area damaged. The intercorrelations for 
the up minus down trials appear to show an 
opposite trend. For these “habituation” scores, 
the neuropathology group have an average 
correlation of .60 contrasted to 48 for the 
psychopathology group. “Habituation” as an 
attitude or personality characteristic would 
be expected to be a generalized effect and not 
specific to the modality. The various mo- 
dalities may vary, of course, in their effective- 


ness as a reliable measure of the “habituation” 
characteristic, 


apparent, which may 
mall size of the sub- 


groups and the lack of certainty of the precise 


localization for many. 
There were five cases with 
lesions. These were tested o 
touch and electricity. There 
the temporal acuity threshol 
laterality of lesion. 


known unilateral 
n both hands for 
was no trend for 
d to be related to 


iving 
neuropathology group, 10 were a i pad 
and 12 were not. The mara a all se” 
higher temporal acuity threshol sation 
modalities. The “error of habi an e 
less for the medicated group. Sinc roup wer 
(19%) of the psychopathology 5 
receiving drugs, in contrast to 
the neuropathology group, dr a 
dicate that not only could t Ro o 
account for our general fine eet hab! 
temporal acuity thresholds and nology at 
ation errors for the ee ye | 
but, rather, the drug effect ™ 
tenuated the differences found. 


ty- 
taking, was related to temporal acul y drugs 

roup 

| 


Conclusions or?! 


1. These results indicate 
acuity thresholds for audition 
be measured with sufficient Te 
useful for the diagnosis of boon vision 4 
The best single indicator is r gn) off 
of habituation” which oar p a 
cases (76%), using the nee most 4 0 
point. Vision down trials were © were 
When the touch variability sco". 
bined with these two, all three 


ere a! 
weighted, 35 cases (81%) Y h A 


tha 
and to af be 
liability 


tholos, 


tho E 
classified with three psychoP* isclas yp 


jp 
five neuropathology cases being “".. ga 


ere ÍS 
Hence, for these samples th 


Temporal Acuity in Psychogenic and Neurogenic Pathology 


diagnostic power by combining several sense 
Patty acuity thresholds and “errors of 
abituation” into a battery. 

2. ihe question as to whether fusion fre- 
ed is a generalized function of the brain 
eens or specific to each sense modality, 
era ae While the lower intervariable 
Specie Hons for the pathology group argue for 
otal et our available samples with specific 
ee lesions are too small to draw any 

actory conclusion. 
eat finding that the “error of habitua- 
th Score is reflecting a characteristic highly 
tee of cerebral pathology suggests that 
en Psychophysical measures, not involving 
ee acuity, should be investigated as 
seen rin of this perseverative tendency often 
Patients with cerebral pathology. 
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Social Desirability and Q Sorts 


Allen L. Edwards 


The University of Washington 


In Q technique, as used in clinical and per- 
sonality research, subjects are often asked to 
describe themselves in terms of a set of per- 
sonality items. If these items differ with re- 
spect to their social desirability scale values, 
then social desirability may function as an 
uncontrolled variable in the Q sorts of the 
subjects. The potential influence of social de- 
sirability on the statistical analysis of Q sorts 
has been described in some detail by Edwards 
and Horst (2). 

Edwards and Horst assumed that social de- 
sirability operated in such a way that the 
weights assigned to the items by subjects 
would be an increasing function of the social 
desirability scale values of the items. This as- 
sumption was based upon research by Ed- 
wards (1). He found that the probability of 
endorsement of an item in a personality in- 
easing linear function of 
ity scale values of the 


Personalit: inventory, 
Present study was id es 


undertaken to rovid i- 
dence upon this point, : ani 


were made available b 
The procedure described by St 
Pp. 59-61) was followed in ob 


istic 
ractet! 
categories, ranging from most cha 


sud 

to least characteristic, were used by tM e 
jects in making their self-descript fixed t 
frequencies for each category nil is: 
resemble a somewhat flattened n be plac 
tribution. The number of items to „M 
in the successive categories was eights as 
20, 27, 20, 14, 8, 7, and 5. The ind of the 
signed to the categories e t being 
integers 1 to 11, with the 11 v ategory: 
assigned to the most descriptive tg the 

For each group of 50 su item 
weight assigned to each of the chen €2 
found. These mean weights were adle 
lated with the social desirability = E TH 
as determined previously by e the nh 
product-moment correlation a 
group was .84 and for the ore f 
was .87. If these results are OF ai sell 
to be expected in Q studies ae ite ms F 


jects 
age, the Q sorts of subjects, | 1 desiraP’ ig 
that we have available the a obtai™ 
scale values of the items use 
the Q sorts. 
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The Reliability of Adjustment Ratings 
and the Length of Case Histories 


A. W. Bendig 


University of Pittsburgh 


goi methodological questions in the use 
a ei scales to quantify clinical judgments 
cen investigated in recent research (3, 
Cited E and Sprague (4) had ten short 
textbook, ase histories, culled from psychology 
8toups S, rated for adjustment level by four 
ente Of Ss: introductory psychology stu- 
uate , identa ai abnormal psychology, grad- 
tini O in psychology, and post-Ph.D. 
were- PYchologists. The first two groups 
Scale subdivided into groups using rating 
S differing in length: 3, 5, 7, or 9 cate- 


Borie tu 
bility - A progressive increase in rater relia- 
in (average interjudge correlation) with 


(ieee educational background was found. 
tween oted was a strong positive relation be- 
the Rt length and rater reliability for 
ationshi, uctory psychology Ss, but this re- 
Psychol ip was not as evident for the abnormal 
uate Ss. In the second study, Bendig 
e the longer case histories abstracted 

3 ce (5) from clinical files. Two 
a oe Ss, introductory educational psy- 
Psycholo Students and graduate students in 
ent leet rated the 10 cases for adjust- 
tion, 65 È using a 7-category scale. In addi- 
tion u S indicated which case history sec- 
ing p most important in determining his 
n the the case. The groups were compared 
magnitude of several types of rating 


erro 

rs 7 P 

cti shown and on their use of various case 
lons, 


Stoup 


eae re Ost obvious difference in the results 
es ia studies (3, 4) was in the magni- 
Sprague tater reliability reported. Bendig and 
Ntercor reported (4, p. 208) that the average 
Cholo, j po among the introductory psy- 
i Ss using a 7-category scale was .47 

9 while the reliability for the psy- 


chology graduate students (W = 16) was 59. 
The comparable reliabilities for the two simi- 
lar groups in the second report (3) were 82 
and .84. Changing the rated stimuli (case his- 
tories) not only increased the size of the rater 
reliabilities, but also tended to reduce the 
difference in reliability of these educationally 
distinct groups of judges. One hypothesis to 
explain these differences is that longer case 
histories (reporting more of the clients’ be- 
havior) would be rated more reliably, since 
the first group of cases were quite brief (ap- 
proximately 100 words each) while the second 
set were much longer (one to two pages of 
single-spaced typing each). A second hypothe- 
sis suggests that the second set of cases, drawn 
from clinic files, covers a wider range of ad- 
justment, or is more heterogeneous on the 
rated continuum (adjustment level) than is 
the first set, which was abstracted from text- 
books. It has been shown (1, 2) that more 
heterogeneous stimuli are rated more reliably 
by introductory psychology Ss. 

The present research was designed to test 
this first hypothesis. The case histories in the 
second set were systematically shortened until 
they approximated the length of the first set. 
Both the “long” and “short” versions of the 
same cases were rated by different groups of 
introductory psychology Ss which were fur- 
ther subdivided into groups differing in the 
length of the rating scale used. This latter 
step was designed to test for the appearance 
of the positive relation between scale length 
and rater reliability previously reported (4). 


Procedure 


Stimuli. Two sets of ten case histories each 
were used as stimuli to be rated. The “long” 
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set consisted of the case histories originally 
compiled by Cummings (5) and later used by 
Newton (9) and Bendig (3). Each case had 
been abstracted from the complete clinic file, 
excluding psychometric information, with the 
S’s behavior reported under seven areas (3). 
The cases varied in length from one to two 
pages of single-spaced typing. In a previous 
study (3) both undergraduate psychology and 
graduate psychology students had rated these 
cases for adjustment level and had also in- 
dicated which of the seven case sections was 
most important in determining the adjustment 
tating they gave the case. The case sections 
checked by one-third or more of the raters 
in either group as being important have been 
reported (3). The “short” set of case his- 
tories used in the present study consisted of 
only the sections judged by either of the two 
Previous groups as being important. The “un- 
important” sections for each case were omitted 
in typing the cases for presentation to the 
raters. Each case in the “short” set was about 
one-half page of single-spaced typing, or ap- 
proximately one-half to one-third its length in 
the long set. The cases of either the long or 
short set were mimeographed as a booklet 
with a face-sheet of rater instructions request- 
ing the judge to read and rate each case for 
adjustment level, using a tating scale pro- 
vided on a separate card. 

Scales. Thre 
ing in the nu 


(scale length), were mimeographed on cards 
with spaces for 


maladjusted,” and the highest cate 
, gory by thi 
phrase “Extremely maladjusted.” The A 


A. W. Bendig 


: al 
uate students enrolled in three a | 
course in introductory psychology. T aca 
history booklets and scales were er h 
distributed to the Ss approximately nai tie 
in the semester with 20 Ss getting eac 11 soalé 
combinationsof case history length side a 
length. The Ss rated the cases 0 ales at # 
class and returned the booklets and A reques 
subsequent class meeting. The pe. made | 
for noncollaboration among the a the {30 | 
in distributing the booklets and i 
sheet of rater instructions. 


Results 


The case histories by Ss matrix 2 
for each of the six subgroups (two igen as 
by three scale lengths) were he yie ding 
two-criterion analysis of se a Al 
mean squares for Cases (df = es results % | 
= 19), and Error (df = 111): jn Table g 
these six analyses can be foun al cant i 
The Cases mean squares were A ng i 
the .O1 level in each subgroup, eh petween tY 
the Ss significantly discriminate! ts of a H 
case histories in their judgmen are for 
ment level. The Raters mean nr 0 “pe 
subgroup using the T-categoty ificant 8 oy 
the long case histories was a 
-O1 level, while the similar =a was SBM ye | 
the group rating the short ee either 
cant only at the .05 level. peroups "g 
Raters mean squares for the ae cant 
9-category rating scales were among Be 
the .05 level. Differences RA all ten oe 
in the average rating they ee pave Ph): 
but these rater differences, W3 (1, 2 3, 
previously termed “rater bias ae 
were reduced with the longer S using 

The pairs of rater subgroup i case 
length scales, but differing bree new 22 ny 
rated, were combined and en describ? ted 
of variance, similar to the mo ore COMP! airs 
Edwards (6, pp. 284-296), W g the 
To test the feasibility of com 
of subgroups, the ratios of 
squares from the two groups i 
and found not to be significa’ ys 
level. The results of these be 
found in Table 2+ with the deposit? 

1 Tables 1, 2, 3, 5, and 7 have ee Orde 
the American Documentation inst ie u 
ment No. 4674 from the ADI Au 


f rating 
e lengt 


binin. 


were 
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homogeneity of the error variances given at 
e bottom of the table. The Cases mean 


Squares were significant at the .01 level in all” 


ae analyses. The Between Groups mean 
ah 5 was significant at the .05 level for the 
eae using the 5-category seale with the 
eg rating the short case histories as 
ever its more maladjusted behavior. How- 
ware © Groups mean square for the 7- and 
cant tec. scales did not approach a signifi- 
intera a of confidence. The Cases by Groups 
01 les nE mean square was significant at the 
gory i oe the subgroups using the 7-cate- 
erms r e, but again the similar interaction 
Gory. oral, the subgroups using 5- and 9-cate- 
levels, es were not significant at acceptable 
oe previously noted (3) that Cum- 
Rise: ) had six psychiatrists rank these 
erived histories for adjustment level and 
Pooled scale values for the cases from the 
8 in wo The ratings of each of the 120 
ese accor study were correlated with 
ae values to give a measure of the 
roduattie reliability” of each S. The 20 
8toup nga correlations within each sub- 
tributed ere transformed into normally dis- 
and test yes by the usual r-to-z technique 
135 E for intragroup heterogeneity (6, p- 
Ues ae of the resulting six chi-square 
Subgroyn S Significant at the .10 level. The 
Btoup E variances were then tested for inter- 
1951o cterogeneity by Bartlett’s test (6, pp- 
not gi ) and the chi-square value (9.11) was 
Pingenifcant at the .10 level (df = 5)- 
analysis the z values were subjected to an 
Di S of variance and the results are re- 
m Table 3.2 The variables of case 
3 or ong vs. short) and scale length (5-, 
fect the Categories) did not significantly af- 
the int Measures of psychiatric reliability and 
Simila action of th variables was 
Milarly sot, OF these two va 
tom te gnificant, 
8, avera, he data used for Tables 1, 2, and 
(avera 8e measures of psychiatric reliability 
Ments) correlation with psychiatric judg- 
» Tater reliability (average correlation 


m 


ie : 
En; 
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Rresg, ‘ pbotoduplication Service, Library of Con- 
theg, tOr mon 25, D. C,, remitting in advance 
NN Dates or $1.25 for photocopies. Make 
taty of le to Chief, Photoduplication Service, 
‘Ongress, 


465 


Table 4 


Summary of Average Individual Rater Reliability and 
Bias Coefficients for Each Group 


Case Length Psychi- 

history of rating atric Rater Rater 

length scale reliability reliability bias 
5 .80** 64"* Are 

Short T P- ia Ai a Ase 
9 3857 .78** 34 
§:* 83 43 .62** 

Long 7 .83** 6* oem 
9 84** ae .28 
5 .82** .68** .60** 

Both 7 Kag fore e 
9 285" ore 29 


* Significant at the .05 level. 
** Significant at the .01 level. 


among the raters within a subgroup), and 
rater bias (variability among Ss in the aver- 
age rating each S assigns all ten cases) were 
computed for each group. These measures are 
described in more detail elsewhere (3, 4). The 
summary values are given in Table 4. Both 
psychiatric reliability and rater reliability in- 
crease slightly (but nonsignificantly) from 
the 5- to 7-category scales, but no difference 
in these two measures is apparent between 
the 7- and 9-category scales. Rater bias de- 
creased with longer scales. There appears to 
be no consistent difference between the long 
and short case histories on any of these three 
measures. 

Mean ratings of the single cases were com- 
puted for each of the six subgroups and the 
case means were correlated with the psy- 
chiatric scale values referred to above. The 
intercorrelations of these mean ratings be- 
tween the rater subgroups were also computed 
and these product-moment correlations are 
given above the principal diagonal in Table 
5. This matrix of intercorrelations between 
the rater and psychiatric subgroups was sub- 
jected to a centroid factor analysis. The analy- 
sis was replicated twice to stabilize the com- 
munality estimates and two factors were ex- 
tracted. The residual correlations between 
groups can be found below the principal di- 
agonal in Table 5 and the unrotated factor 
loadings and communalities for the seven 
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groups are given in Table 6. The first general 
factor accounts for the great majority of 
covariation among the subgroups and appears 
to be a general “agreement” factor present 
in the mean case ratings of the rater sub- 
groups. Factor II is bipolar with the psy- 
chiatrists and student raters using the 7-cate- 
gory scale with the short case histories on the 
negative end of the factor continuum and the 
three rater groups rating the long cases at the 
positive end. The groups using the 5- and 9- 
category scales to rate the short cases fall 
midway between these extremes. Apparently 
the Ss rating the short cases were slightly 
more similar to the psychiatrists in their judg- 
ments than were the Ss rating the long case 
histories. 

In Table 7? are given the mean ratings 
given each of the ten cases by the six sub- 
groups and ¢ tests of the significance of the 
differences between mean ratings given the 
long and short cases by subgroups using the 
same length of scale. Standard errors for the 
tests were derived from the error mean 
Squares in Table 2. The probabilities from 
the three ¢ tests for each case were combined 
by the chi-square technique of Fisher (7, 8). 
Three of the combined chi squares were sig- 
nificant at the .01 level (cases 7, 8, and 10) 
while two were significant at the .05 level 
(cases 3 and 5). In one case (case 10) raters 
receiving short case histories rated the case as 
less well adjusted than those rating long 
cases, while the other four cases were rated 


Table 6 


Factor Loadings (Decimal Points Omitted) for Rater 
Groups Derived from Intercorrelations of Mean 
Case History Ratings of Groups 


Unrotated 
fact 

Rater Case Length of on sig 

group length scale I Il h 
1 Short 5-Categories 988 015 
2 Short 7-Categories 971 —128 is 
3 Short 9-Categories 988 013 976 
4 Long 5-Categories 982 103 975 
5 Long 7-Categories 991 111 994 
6 Long 9-Categories 991 087 990 
7 Psychiatrists 948 —138 918 


. Bendig x 
as being more well adjusted by the short case 
history subgroups. 


Discussion 


jmination 
The question of whether the ne 7 
from case histories of material a Alb 
judged to be unimportant will adversi i 
fect the reliability of judgments © pears 
ment derived from the case histore E dif- 
to be answered negatively. No sign! A rating 
ferences were evident between the Pn aver- 
the “long” and “short” cases either 
age intercorrelation among the $ F 
liability) or their correlation wit r 
judgments (psychiatric reliability). int! 
the factor analysis of the subgroup it at 
relations of mean case ratings suger mewbst 
the Ss rating the short cases were the PY 
more similar in their judgments to a 
chiatrists than were the Ss 7 spree” 
case histories. The elimination 0 i 
vant material from the cases may t the PS 
nated distracting information that “ onsi 
Lape anal ¿cluded from that 
chiatrists consciously ex t 
wa is ‘ ir judgments, 5) 
eration in forming their judg long 
the more naive Ss, reading the P 
allowed to bias their ratings. ait found D 
The difference in rater eager ee: ( 
one study that used short case longe" 
and a second study in ahit be ex? 
were used (3) apparently en rences: 
on the basis of case length di o veal 
length of the cases in the presen 
comparable to the first study 
magnitude of reliability is ee 
to those reported in the on repo! 
Apparently the lower reliabilitie to 
Bendig and Sprague (4) were ologic” a 
selection of the cases from psy pee? wot 
books. These cases may bav jeve! t 
more homogeneous in adjusthe i 
are the present case Histories ai 
homogeneity of the rated sti (A, 
shown to reduce rater reliability 5g rem atl! 
The previously reported pos i d 2 
ship between rating scale mi vider cal 
reliability (4) was not strong sign! ate 
the present results. A small, e 6 
increase in reliability from any teren 
gory scale was noted, but no tego 
found between the 7- and 9-C4 


pi 
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ee discrepancy between the two studies 
RA be attributed either to omnipresent 
ma ce, or to the differences in the absolute 
oe of rater reliability found. The 
be a Ss were about as reliable as judges can 
ok rp to be, while the Ss in the previous 
mst F showed relatively low reliability. The 
iter able hypothesis is that there is a 
Tater a between scale length and 
relation iability, but that the strength of this 
of Tater decreases as the absolute magnitude 
would 4 reliability increases. This hypothesis 
was f also explain why a strong relationship 
while a for introductory psychology Ss, 
educati is relation was less aparent for more 
naive aly advanced Ss (4), since the less 
liability, rs also displayed greater rater re- 
a decrease in rater bias with longer scales 
Noted $ markedly with the opposite result 
explan, Y Bendig and Sprague (4). No ready 
oen of this discrepancy, other than 
vious chance or case differences between 


e 
er Ro researches, appears plausible. Fur- 
evidence is needed on this point. 
l Summary 
n 
tät troductory psychology Ss (N = 120) 


ate 3 
As for adjustment level long and shortened 
either s of ten case histories using scales with 


5, 7 


Measures of rater reliability, but a factor 
ig of the intercorrelations of mean case 
e aE the subgroups, and with the 

ings of psychiatrists, indicated that 


Were f » or 9 categories. No differences 
i ound between the long and short cases 
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the ratings of the short cases were slightly 
more similar to the psychiatric judgments 
than were the judgments of the longer case 
histories. Rater reliability increased slightly, 
but nonsignificantly, between the 5- and 7- 
category scales, while no difference in re- 
liability between the 7- and 9-category scales 
was evident. Rater bias tended to decrease 
with the longer scales. 
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Some Evidence on the Validity of the Sarason 
Test Anxiety Scale 


Barclay Martin and Bruce McGowan 
University of Wisconsin 1 


Sarason (1) has developed a scale designed 
to measure how anxious a person feels in test- 
ing situations. This Paper reports further evi- 
dence bearing on the validity of this test, 

Two extreme groups of 18 Ss each were 
selected from a class of 340 students, on the 
basis of a slightly modified Test Anxiety 
Scale, and then seen twice in individual ses- 
sions. Both sessions consisted of a 4-minute 
rest period followed by a 5-minute discussion 
of their feelings and attitudes about test-tak- 
nar skin conductance 
were taken at regular intervals. The first ses- 
the semester when no 
ere being given, and 
urred within the hour 
Preceding a course examination. Three things 


periods than the low- 
5); (b) it is also ap- 


7 An extended Teport of this stud 
tained without charge from Barcla: 
chology Dept., Univer, of Wi 


vis o OF for a fee fro 


g in advance 
Photocopies, Mal 
to Chief, Photoduplication Service, 
gress. 


bordel: 
these decreases tended to be of ve: signif 
line significance; (c) there yer i 
cant differences in relative cha oe rom 
the high- and low-anxiety _ signifi 
sion 1 to Session 2, and also e 
differences in relative change x $ 
discussion period in either sessio aois a 
These results suggest that Sa m a 
reflects partly a general anxiety ET c 
accounts for the general aimera H 
ductance level between the mour about i 
ther be concluded that apprehent ioia oF 
experimental session itself overs bo 


as a result of familiarity wi 
and knowing what was likely “aa 
session. These results raise ga jg the inte 
how specific to testing situatio eases) f 
iety that the Sarason Scale pa for BIS? ye 
there was no differential ten 
compared with low test aiey otherw!* 
anxious right before a test mak 
may be that most of the dif ot Jow ote 
performance between high a factor 

are due to a general anxiety 

than to specific test anxiety. 


Brief Report 
Received July 14, 1955. 
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Movement as a “Rhetorical Embellishment” 
of Human Percepts 


Leon H. Levy 


Indiana University 


oap the human movement response, 
interpret ayed a major role in Rorschach test 
“to reai i Beck describes it as opening 
fective igation a sector of personality that, 
8 cour as it is in determining the individu- 
to stud S3 has been equally elusive of efforts 
tempts hat objectively” (2, p. 22)—few at- 
Ssumpti ave been made to test Rorschach’s 
the i lon regarding its nature. Thus most of 
of yy C Pretive hypotheses based on amount 
ticated a Rorschach protocol are still pre- 
Sents a (Pom the assumption that M repre- 
Kinesth, Projection by the subject of certain 
8, 9), etic experiences into the blot (2, 3, 
T s 
i hme ki no dearth of speculation concern- 
mkblot inesthesis may be stimulated by the 
Matter cf other static visual stimuli, for that 
data ¢ (1, 7, 12). But as yet no empirical 
necesan firm the occurrence of the conditions 
Muscu] 4 for kinesthesia, viz., changes in the 
( bor ure of the individual. Indeed, as Rust 
Stori inted out, Rorschach cautioned against 
Subject in many instances even when the 
his Der resorted to gestures to communicate 
u aS It is therefore doubtful whether 
non-M responses will ever be distin- 
On other than a verbal basis. But 
Orschach specifically differentiated be- 
Senseg ; eSPOnses resulting from “movement 
ich at the figure” (6, p. 25) and non-M 
the ioe ‘only a rhetorical embellishment of 
25), eee a secondary association” (6, P. 
Must tie clear that the scoring criteria for M 
Donverbal E some nonverbal measure. Since 
Rorschach indices did not prove expedient, 
ave re and those who have followed him 
Ment 6 asoned that one could sense move- 
nly if one perceived the movement as 


occurring in a human figure, so that only hu- 
man movement is scored M. The scoring is 
based on the concept of empathy, whereby it 
is assumed that a person cannot empathize 
with animals or inanimate objects, but only 
with other humans. Since the concept of 
empathy is itself not clearly defined, the prin- 
ciple does little to clarify theory or practice. 

To those who prefer concepts somewhat 
better defined than M is, there appear to be 
two alternatives. The one is to discard the 
term entirely, while the other is to redefine it 
in terms which are more verifiable. In many 
instances the former alternative is to be pre- 
ferred. In the case of M there is some evi- 
dence (4, 5, 10, 11), albeit not entirely un- 
equivocal, of meaningful relationship to other 
psychological phenomena, so that the more 
conservative approach would appear justified. 
M may be a valuable correlate of certain psy- 
chological phenomena regardless of whether 
or not Rorschach’s conception of its nature 
was correct or whether or not his interpreta- 
tion is testable. If some more adequate con- 
ceptualization of M is possible, its interpre- 
tive value may be further enhanced. 

The explanation offered in this paper is one 
with which Rorschach would undoubtedly 
disagree. It is proposed that M is best un- 
derstood as a “rhetorical embellishment” or 
“secondary association” to use Rorschach’s 
own terms; that it is an epiphenomenon of 
the tendency to perceive human figures in the 
stimulus material. 

This view of M is predicated on the hy- 
pothesis that when a person is asked to de- 
scribe a human figure or a stimulus taken as 
representing a human figure, there is a high 
probability that movement of one kind or an- 
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other will be among the attributes cited. De- 
scribing any object is accomplished by listing 
its attributes. Since one of the most fre- 
quently reported attributes of the human or- 
ganism is movement, the taking of some po- 
sition, engaging in some kind of activity, etc., 
it should be expected that these attributes will 
be among those cited by the individual in his 
report of his perception of any visual stimu- 
lus he takes to represent the human figure. 


Hypothesis 


The frequency of occurrence of verbal re- 
sponses classifiable as movement responses in 
subjects’ reports of their Perception of cer- 
tain visual stimuli having no common cul- 
tural interpretation will be directly related to 
whether or not these stimuli are presented as 
Tepresenting human figures. 


Procedure 


The 112 subjects (Ss) used in this study 
consisted of all those members of four discus- 
sion sections of an introductory psychology 
course who were present on the day of the ex- 
periment. 

Ten stimulus figures were constructed by 
combining three lines: two one and one-half 
inch lines joined to form a 60-degree angle, 
and one two-inch line drawn so that one of 
its end points was the apex of the angle 
formed by the other two lines. The figures 


he angle of the longer 
vertical, and also by 
angle formed by the 
the two shorter lines, 
ted to Ss in booklet 
to a page. 


possible. 


Leon H. Levy 


The Ss in Group NH received identical | 
structions except that the italicized ee 
was deleted. In each case these eae 
were also repeated orally by the rani: 
All responses were scored for M using 
fer’s criteria (3). 


Results k. 
The mean number of M pe ee ‘at 
Group H was 8.62 as compared with 1. ee 


Group NH. Because of the nonnina a 
ture of the distribution, chi square ie ae 
in testing the hypothesis. Chi e By 
culated for a 2 x 2 table comparing bove 3 
ber of cases in each group falling & ad Gi 
below the median of the total ae chi | 
With Yates’s correction for one he 
square was 82.312, significant bey 

.001 level. 


Discussion 


y reta 

The results seem to support the wo est 
tion that amount of M in a oe of the 
protocol is a function of the on os m 
individual to perceive human nge the find 
biguous visual stimuli. In one SF ca only bs 
ing comes as no surprise since H ans on? 
scored for human percepts, but ing can P 
to question what more, if A ‘ 
said regarding the nature of M. rious int 

What is to become of the va on M? 
pretations which are dependent up 
the extent that interpretations are jack 
only upon rational exposition p disca" 
pirical justification, they MA at they ee 
with impunity. To the extent a they Por, 
been found to be empirically va ems cente 
new and interesting research prob the PS oe 
ing around the question: What 15 to perry 
logical significance of a tendency a] stim" yy 
human figures in ambiguous Yni that bh 
Since it appears from the find! jance of rd 
does not account for all of here Yb 
further research might be sugividul gi 
studying instances where an m : 
a non-M human response. ro a | 

The “scoring” of : Rorschach oe E w 
might best be construed as a PIO proper | 
analysis of verbal behavior. 
faced in Rorschach test rera 
determining what the most us z 
analysis shall be and how they ĉ 


poc! 


fu 
e Te 


Movement as “Embellishment” of Human Percepis 


other psychological phenomena. The findings 
Suggest that unless M can be shown to be 
seeped related to other psychological 
Es in a way which is independent of 
Mes scores, particularly the content score H, 

ight best be discarded. The result should 
€ a simpler classification system of the same 
analytic power. 


Summary 


hype periment was performed to test the 
tes esis that the tendency to give verbal 

Ponses scoreable as human movement, M, 
fa Orschach test scoring standards, is di- 
ida om lated to the extent to which the in- 

a takes the visual stimulus to represent 
both ar figure. The justification for scoring 
Wags and H in Rorschach test analysis 
imi toned in the light of findings con- 

ng the hypothesis. 


Rece; 
ceived March 14, 1955. 
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The Measurement of Primary Mental Abilities 
by the Columbia Mental Maturity Scale 


Cyril R. Mill and Charles J. Turner 
Richmond Public Schools, Richmond, Virginia 


The Columbia Mental Maturity Scale 
(CMM), published in 1954, was designed to 
measure the mental ability of children in the 
MA range from 3 to 12 years. Since the only 
response required is to point, it was thought 
suitable for use with children afflicted with 
cerebral palsy or other handicaps involving 
motor or verbal functioning. Administration 
and scoring are simple and testing time runs 
about 15 minutes. It is a potentially useful 
test for a quick measure of intelligence in 
clinic and school use with normal children, 
This study investigated the validity of the 
CMM IQ'’s, factors of intelligence measured 
by the CMM, and age levels at which it 
functions best, 

Seventy-five normal (nonhandicapped) chil- 
dren, equally divided by sex, from ages 7-0 
to 11-11 years, were administered the CMM 
and the SRA 


+ An extended Teport of 
tained without 
12th Street, Richmond, Va. 
American Docu 
from the latter 
from ADI Auxi 
duplication Servi 


source, order Docu: 
liary Publications 
ce, Library of Co; 
ton 25, D. C, remitting in advance 
film or $1.25 for photocopies. Make checi 

to Chief, Photoduplication Service, sae 
gress. 


ith 
s: WI 
subtests of the PMA were as follow 1; 


ing, « 
Reasoning, .61; with Verbal MEENA with 
with Perception, .48; with Nabea cMM 
Space, .31. These 7’s suggest he measure of 
is most heavily weighted with te Tt cot- 
reasoning and understanding of i rical abilit 
tains a moderate measure of eat quic 
and ability to perceive small ye mea 
and accurately, and there is a sig 

perception. 

ay ‘ates CMM IQ’s were 


mean PMA Total IQ’s at all a ani Fi 


that 
higher aa. 
levels test 


. 15 
The differences were not poe ue 
nine- and ten-year levels. me eig F a 
were significantly higher for 


olds (5% level) and for the 7 anc ion uly 
olds (1% level). The clinical ae n 
that an excessive number of e result t 
ogy problems was used, with the tasks 
some children learned to solve ae? 
the analogy principle without © a 5 
twWIC ie, 
The SD of the CMM 10's "Total i 
large as the SD of the PM tly mor ier 
Scores for boys were sea nae to ares? 
able than for girls, possibly exes B 
ences in social maturity of the $ 
age levels. 
“This study indicates that t esis, 
ures reasoning and verbal Tt is not Spt 
though it is a nonverbal tek cal uses resl 
ciently valid at present for cH a 
with further refinement it cou or poth 
need for a quick IQ measure 
mal and afflicted children. 
Brief Report. 
Received August 23, 1955. 
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Reactions to Rorschach Cards IV and VII as a 


Function of Parental Availability in Childhood 


Ralph Hirschstein and Albert I. Rabin 
Michigan State College 


ama orschach workers have for some time been 
tional of the symbolic value and interpreta- 
ticula importance of individual inkblots. Par- 
Dan ae has been paid to Cards IV 
kurës as symbolizing the father and mother 
practic, respectively. Despite this widespread 
ec €, there is little explicitly stated in the 
Prétation in support of this symbolic inter- 
ing an. Bochner and Halpern (1), speak- 
Eure ard IV state that “The heavy male 

> p May suggest the father or authority. 
qualit In Card VII they see “. . . a feminine 
tions A frequently with maternal implica- 
dence h ore recently, some experimental evi- 
symbolic been marshalled in support of the 
Schach c meaning of the aforementioned Ror- 
Upon eg (2, 3). This evidence is based 
the “haga questioning of subjects regarding 

| Teprese er and mother figures which might be 
> baseg ae by the inkblots. The results are 
Critica] Aey on conscious association and 

e reflection of the individuals tested. 
Was to Purpose of the present investigation 
Olic si a an indirect check on the sym- 
Schac ue of Cards IV and VII of the Ror- 
dividual The main hypothesis was that 
aa fi. who are adolescent delinquents 
Significa ose early background there were no 
ac i nt mother or father figures would re- 
Carg ha readily and more easily to these 
ents an would a similar group of delin- 
si tea grew up in the standard family 
Quin, > 22d who had the opportunity of ac- 
Utes, R conceptions of father and mother fig- 
Isturbing as they may be. 


Method and Subjects 


T 
e : 
Male jaa jects of the present study were 40 
enile delinquents, divided into two 


groups of 20 each. The two groups were 
matched for age -and intellectual level of 
functioning, the mean ages being 15.2 and 
15.3 years, respectively, and the mean IQ’s 
97.6 and 96, respectively. All subjects had 
been placed by the courts at the Boys’ Vo- 
cational School at Lansing, Michigan. None 
of the delinquents used in this investigation 
revealed any psychotic manifestations or or- 
ganic involvement upon psychiatric examina- 
tion. Group NF (Non-Family) consisted of 
twenty youngsters who had no opportunity 
of living with their natural parents and who 
had been moved around from one foster home 
to another since infancy. The F (Family) 
group consisted of twenty youngsters who had 
been living with their own families (parents) 
continuously until the time of their arrest. 
Causes precipitating arrest were similar for 
both groups. Most common reasons for arrest 
were in order of frequency: car theft, break- 
ing and entering, and school truancy. 

Rorschach records were obtained on all 
subjects under standard conditions of exami- 
nation. Analysis of the data concentrated on 
the differences between the two groups with 
respect to Cards IV and VII. In accordance 
with our hypothesis, the expectations were 
that the “family” group would show greater 
difficulty in responding to Cards IV and VII 
than the “non-family” group. The underlying 
assumption is that part of the delinquents’ 
difficulty lies in the intrafamily relationships 
which may be reflected in Cards IV and VII. 
This should not prevail for the “non-family” 
group who had no definite parental relation- 
ships. 

Results 

The two groups were compared with respect 

to form quality (F + %), productivity (R), 
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Table 1 


Significance of the Difference of Percentage of the Total 
Number of Responses to Cards IV and VII 


Family Non-family Level of 
group group t significance 
16% 18.5% 1.68 10% 


and “reaction time to first response” on Cards 
IV and VII. A comparison of the F + %, for 
Cards IV and VII, yielded no significant dif- 
ferences. When the mean productivity for 
Cards IV and VII, combined, was compared 
for the two groups, a slight trend favoring 
the “family” group was noted. (See Table 1.) 

A comparison of reaction times to the 
individual Cards IV and VII indicated differ- 
ences in the expected direction. The mean re- 
action times for both groups, for all ten Ror- 
schach cards, is given in Table 2, The only 
differences that were found to be statistically 


Table 2 


Small Sample Tests of Significance of Difference 
of Means of Reaction Times to All Ten 
Rorschach Cards for the Family 
and Non-Family Groups 


Non- 
Family family 
group group 
Mean Mean Level of 
Cards R.T. R.T. t significance 
1 20.55 15.20 .56 insignificant 
2 17.20 13.50 .59 insignificant 
3 13.10 6.80 95 insignificant 
4 31.85 15.90 2.01 2%-3% 
3 ee By 89 insignificant 
7 ni pgs oy mae 
s STA 17.85 All insignificant 
4 21.95 07 insignificant 
10 16.80 13.55 95 i 


insignificant 


Ralph Hirschstein and Albert I. Rabin 


significant are those obtained on Cards y 
and VII. The “family” group reacted ua 
slowly to these cards than did the n 
family” group. ; A 
It cae that the youngsters wih oi 
nary family background were i E 
blocked when responding to Cards I ke 
VII; the youngsters with no parental be 
ground did not show this blocking. It Te 
seem that one can differentiate deg ns 
lacking a stable parental figure se ait 
possessing one, on the basis of reactio 
to Cards IV and VII. 


Summary 


jects; 

Two groups of male delinquent eee 

matched for age and intelligence, D iy in 

ing with respect to parental ae pasis 
early childhood, were compared on 


d 
Iy 
of their reactions to Rorschach Cards tn their 


more 


n 

had no real mother or father figure tO i o di- 
with. Furthermore, a slight trend pA hese 
rection of restricted produce ad grow? 
cards, was noted in youngsters wio se rest 
up with their natural parents. T ajot of 
are offered as further evidence i sym" 
the hypothesis that Cards IV an 


bolize parental figures. 
Received March 22, 1955. 
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Rorschach Content and Hostile Behavior’ 


Martin R. Gluck 


Mental Hygiene Consultation Service, Fort Lewis, Washington 


mo of major concern in the use of 
Voked lve techniques, and one which has pro- 
of th arguments both pro and con, is that 
muah, € relationship between the content of 
Mi tols and the testee’s overt be- 
sae Piotrowski (8), Wittenborn (11), and 
imply E (9), for example, either state or 
record at direct prediction from projective 
most S to overt behavior is possible. Klopfer’s 
eee recent Rorschach manual (7) discusses 
anal Problems of prediction and content 
ee much more fully than did his older 
Teenie ); While Beck (1), too, in one of his 
stresse reviews of the Rorschach technique, 
Meanin, the need for further research into the 
the a 8 and importance of content. Lastly 
at MoNS work-a-day experience suggests 
gists ne of projective tests, both psycholo- 
to m Psychiatrists alike, frequently tend 
cord ake such predictions and to act in ac- 
ance with them. 


str tility especially its direction and 
whine is one of the major dynamic forces 


Upon e projective tester may be called 
Orschs, assess through the medium of the 
eref ach technique. The present study is 
ag ore focused on the question: Can hostile 
A) behavior be predicted from the 

Cont Int of hostility (aggression) found in the 

ent of Rorschach protocols? 


1 
ae on a dissertation submitted to the Grad- 
me chool, University of Pittsburgh in partial ful- 
of = of the requirements for the degree of Doctor 
and ilosophy, The author acknowledges the help 
Spec ence of his dissertation committee, and 
$ Rw, thanks Doctors A. David Lazovik and A. 
the pee: Thanks are also due to the members of 
Sim, 3 chology Section, Neuropsychiatric Service, Fitz- 
Scheid, Army Hospital, and to Mrs. Elizabeth J. 
Stateme for rescoring the Rorschach records. The 
autho, ents and conclusions of this study are the 
or „XS and do not necessarily reflect the opinion 
Policy of the Army Medical Service. 


Prior research of this “predictive” kind has 
used criteria which have differed widely, 
not only from this paper but from one an- 
other. In an early study Young and Hig- 
genbotham (12) searched for agreement in 
major psychological areas between Rorschach 
protocols and a large mass of behavioral data 
(e.g., case histories, counselors’ records, etc.), 
concluding that, although single determinants 
and simple ratios were not very useful, the 
Rorschach does reflect “ . . . potential forces 
and tensions within the individual . . . the 
resolution of [which] appears in behavior rela- 
tive to specific environmental stimuli” (12, p. 
93). 

Elizur (3), with a scoring system for 
evaluating both anxiety and hostility as ex- 
pressed in Rorschach content, compared the 
amount of projected hostility with measures 
of other kinds of hostility based on a ques- 
tionnaire, a self-rating scale, and the judg- 
ments of observers watching the subjects’ be- 
havior in an interview situation. He reported 
significant correlations between all of the 
variables used and, in addition, demonstrated 
that the use of the content scores could dis- 
tinguish between the records of normal sub- 
jects and neurotic ones. Following Elizur’s 
lead, Walker (10) constructed a more refined 
scale and reported significant correlations be- 
tween Rorschach content scores and thera- 
pists’ evaluations of hostility in their patients. 


Problem and Definitions 


Because of the divergence of the criteria 
used in the studies reviewed and also because 
of the differing kinds of scale systems used 
to evaluate Rorschach content, it seemed 
useful to carry out a further study in which 
the criterion situation (and the “predictor” 
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scale) were tailored to the specific problem 
being investigated. 

Therefore, the following three hypotheses 
were formulated. 

1. The more overt hostility a subject ex- 
presses in his projective records, the more he 
will react with hostile behavior when placed in 
a situation which is provocative of such be- 
havior. 

2. The more covert hostility a subject ex- 
presses in his projective records, the less he 
will react with hostile behavior when placed in 
a situation which is provocative of such be- 
havior. 

3. Subjects who have a large amount of 
hostility of both kinds in their records will 
react with more hostile behavior than subjects 
whose total amount of hostility (in their 
records) is relatively less. 

“Behavior” appears here in the sense of 
gross actions or activities which are readily 
observable by another individual. “Hostility” 
is also used in the broadest fashion; that is, 
it is meant to connote feelings and/or actions 
carrying the idea of such words as anger, 


hatred, resentment, irritation, and exaspera- 
tion. 


Method 


Subjects in this research were thirty pa- 
tients of the Neuropsychiatric Service, Fitz- 
simons Army Hospital, who were given a 
standard test battery as an integral part of 
their individual psychological evaluations; the 
Rorschach was administered to each subject 
individually and in each examiner’s usual 


were all psychology 
hospital. The author 
total number, while 
were obtained by the 
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ag indi- 
on three of the tasks. Statistical ie na 
cated that the observers’ iudemen® i 
tility were reliable and discriminating. 


in, 
The Rorschach (Hostility) Content Ratai 
Scales 


m e 

Although there was some recognition oi E 
difference between openly expressed E bo 
directly or covertly implied hostility viters 
Elizur’s and Walker’s work, these wae k 
did not directly attack the probie a 
Consequently, it was decided to Seat 
appraisal of these seemingly ind ex 
different expressions of hostility. the afore- 
amples and definitions gleaned from nih (2) 
mentioned two studies and from De th Overt 
paper, scales were constructed, for bo ‘rangin 
and Covert expressions, with values cable, Í 
from 0 to 2. Before the scales were poin! 
was found necessary to redefine at ratel: 
on the scales jointly with the ot entionel 
Sample responses from the pect ot 
above were employed as examp. a of the 
various scale points. This joint eer 
scale points should be borne 1n resented 
evaluating the reliability figures P” ; 
Table 1. : ich h0% 

“Overt” responses are those m pee 
tile, aggressive feeling is plainly me no inte 
the content, thereby evoking little net abe!’ 
pretation by the clinician pelor respons 
these responses as hostile ones. Suc aon ac 
have content which carry a com aggressi 
cepted (i.e., “everyday”) hostile or 
connotation. ‘ ich © 

“Covert” responses are those ae „mibol? 
hostility is perceived by means aie “4 
interpretation, and which have A accept 
does not usually convey a omni 7 of & A 
connotation of hostility. Ta cent? 
point on both of the scales used a" 


below. upo” 


as 7 

For the Overt Scale responses ae a any 
charging each other,” “Two ss » and Py, 
really fighting—you can see the Trost Jptens? ch 
mals shot” received a rating of 2 ( giveD oF 

A rating of 1 (Less Intensive) Sie n ni 
responses as “Spears used by Indians, g K y 
some person,” “Pistol,” “Arrow,” u scale pis 

Similarly, a 2 rating on the ee 
given for responses like “Drunk 
e 


” iscussion WOL 
2A somewhat more detailed z repor! d 
criterion measure has been previously 


Rorschach Content and Hostile Behavior 


Table 1 
Reliabilities of Rorschach Scales 
(N = 30) 
Rating Overt Covert Total 
Independent Ratings 83 67 68 4 
Combined Ratings 91 -80 381 9 


~ “Birds dressed in men’s clothing,” and “Bat 
a torn wing.” 
hae Covert rating of 1 was applied to responses 
rhe to “A volcano,” “Teeth,” and “Torn leaves.” 
deni. foregoing are not all of the examples used to 
re e scale points. In addition to further ex- 
mene the scales in their final form included state- 
S of definitions of each of the rating points. 


ee rater scored the full Rorschach pro- 
Seale scoring each response on whichever 
tive was appropriate. By adding the scores 
Sean each of the scales, the subjects re- 
dies three content hostility scores: an Overt 
(Ove, a Covert score and a Total Score 
Miele. plus Covert scores). The reliability 
Dute Teg presented in Table 1 were com- 
ee these three sums. The final Ror- 
ni Hostility Scores were obtained by 

ing each of the three scores arrived at 
py Ea of the two raters, permitting the use 
and ts Spearman-Brown formula | (4, p. 390) 
i ea: in heightened reliabilities for the 
ina ea ratings, and then dividing the com- 
respo Score for each scale by the number of 
act mses in the record. In recognition of the 
ieee the significance of a response or 
term, of responses is frequently judged in 
t 3a of the length of the record, it was felt 
kas use of such a ratio score was de- 

e. 

a correlation between the Overt and 
va Ss Rorschach Hostility scores was .33, a 
Re which approaches significance at the .05 

H Apparently, the two scales used were 


n x é 
ot independently tapping qualitative dif- 
erences, 


Results and Discussion 


The results of the comparison between 
cone Hostility Scores and the Criterion 
si ae (composite rating of behavioral expres- 
ee of hostility in the stress situation) show 
Significant correlations, the correlation Co- 
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efficients between the Criterion Score and the 
Overt, Covert, and Total scores being .07, 
18, and .16. 

Contrary to the previous studies already 
cited, none of the three hypotheses of this 
study receive support from these data. The 
first consideration which comes to mind in 
comparing these findings with those of previ- 
ous investigators is the difference in the 
criteria measures used. Walker worked with 
material derived from therapy, while Elizur 
used other test data and judgments from a 
relatively benign situation. The question then 
arises which, if any, of the methods is most 
appropriate or useful from the point of view 
of their relations to the patients’ environ- 
mental situations. Walker’s approach has 
merit from the standpoint of a therapist ask- 
ing for help in planning the therapeutic situa- 
tion, but neither his nor Elizur’s criteria seem 
to bear directly on broader life situations, e.g., 
those incidents where the patient is faced by 
the threat of a strong frustration and/or an 
authority figure. 

Tt was felt that in the research reported 
here the presence of a hostile and hostility- 
provoking authority figure, such as was the 
administrator of the stress situation, might 
well make the situation similar to those in 
which patients frequently have difficulty ad- 
justing. However, this strong authoritarian 
examiner may well have provoked the anxiety 
necessary to inhibit the hostile action at the 
same time that he was provoking hostile 
feelings within the subjects. 

This leads directly to a second considera- 
tion, i.e., the overlap of the functioning of the 
Overt and Covert Scales. As was noted earlier, 
the Rorschach content scales used here are 
not nearly as independent as one might wish. 
Both the author and the second scorer were 
impressed with the possibility that the sample 
responses might reflect anxiety feelings in ad- 
dition to those of hostility in a kind of in- 
termingling that has been noted by De Vos 
(2) and Elizur (3). Such a mutual relation- 
ship would have much significance for the 
type of prediction attempted in the present 
study, for without considering the role of 
anxiety as an inhibiting (as well as provoking 
agent it appears that adequate prediction will 
not occur. 
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Conclusions 


From the foregoing data it is concluded 
that simple assessment of the amount of hos- 
tility contained in the content of a Rorschach 
protocol does not provide an accurate index 
to the patient’s proclivity or ability to behave 
in a hostile manner in what seems to be a 
hostility-provoking situation. 

Other pertinent factors related to the 
amount of anxiety present, effective controls 
available (e.g., Form Level, quality of M, 
FC to CF, etc.), and direction or target of 
hostility will have to be more precisely de- 
scribed before we will have accurate predic- 
tion of the type sought for here. In this re- 
spect the writer differs with Korner’s view 
(in Klopfer 7, pp. 490-491) that projective 
techniques are most valuably used in “. . . 
fantasy exploration . . .” and concomittantly 
that prediction of behavior is not necessarily 
desirable. Instead, the orientation expressed 
in Ainsworth’s introduction to the same chap- 
ter (7, Ch. 14) is more congenial to that of 
this paper inasmuch as it is felt there is use- 
fulness in research on the predictive abili- 
ties of interpretive hypotheses. Although the 
results presented here certainly evoke reser- 
vations about such an application of content 
rating scales, the technique used in establish- 
ing a criterion measure does seem to afford 
a workable approach to the problem of re- 
ceiving reliable judgments of “emotional be- 
havior.” 


Summary 

1. Hypotheses relatin 
content to hostilit: 
ior were stated, 

2. Subjects were given a Rorschach ex- 
amination and the i 
voking stress situati 
hostility displayed 
three judges. 

3. The content of the 
was rated on scales whic 


g hostile Rorschach 
y expressed through behav- 


Rorschach records 
h were designed to 
of hostile content. 


Martin R. Gluck 


4. Correlations between scores from ye 
Rorschach content scales and the subjec 
behavior were found to be nonsignificant. a 

5. Pertinent points were considered in ia 
lation to these findings and suggestions 
the direction of future research offered. sare 

6. It was concluded that the pt a 
offered were not supported by the data 
sulting from the study. 
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A Statistical Comparison of the WISC and 
Wechsler-Bellevue, Form I 


John R. Price and Gareth D. Thorne * 


University of Denver 


Few studies making a comparison between 
the WISC and Wechsler-Bellevue Form I in 
an experimental situation have been reported. 
The need for such studies seems apparent 
ìnsofar as both instruments are being used 
currently on the assumption that they are 
equivalent in the overlapping age range, 10 
to 15 years. In clinical situations the choice 
of Which of these two tests to use with chil- 
dren in this age range has been left to the 
ent of the Æ who has little recourse to 
i studies to aid in making this de- 
T Because of the widespread use of these 
en — in clinics and school systems, it is 
tani ri the assumption of equivalence war- 
i urther investigation. The hypothesis as 
wee” in this investigation is that the 
tie and the WB Form I are not equivalent 
ie Tuments with respect to the Verbal, Per- 
afore, and Full Scale scores within the 

ementioned age range. 
oom (2) dealt with the problem of 
Ghat alence insofar as his sample of _unsuc- 

Sful readers had been evaluated in part 
ve ER the use of these two tests. This in- 
tone ee however, was primarily con- 
tisti ed with subtest analysis and did not sta- 
ieee treat the Scale scores. In a study 
3 8 mentally retarded children, Vanderhost 
A (4) used a design similar to the one 
me oyed in the present investigation and 
sea € comparisons of the means of each Scale 

re with every other Scale score of the 


1 
ins writers wish to express their indebtedness to 

Aces Ellis Graham, Joel E. Greene, and William 
this awrey whose helpful advice and assistance made 

Study possible. 

talinin Thorne is at present Assistant Director of 

North © at the Caswell Training School, Kinston, 
Carolina. 


tests used. In an investigation with normals, 
Delattre and Cole (1) were primarily inter- 
ested in various comparisons of subtest scores 
but reported the obtained Scale scores in 
their article. 


Method 


It was considered advantageous to employ 
an experimental design that would permit the 
use of one group of Ss for both tests. In or- 
der to prevent practice effect from either test 
influencing the results, the test to be ad- 
ministered first to each S was determined us- 
ing a table of random numbers with the re- 
striction that each test be administered first 
an equal number of times. 


The criterion for selecting Ss was solely chronologi- 
cal age. The lists of Ss were compiled in such å man- 
ner that at the anticipated time of testing each S 
would be at least 11 years, 44 months or 14 years, 
4} months of age respectively, and at most 11 years, 
74 months and 14 years, 73 months in each age 
group. The sample was selected from local school 
systems and consisted of 40 white, American chil- 
dren at each age level. Each group consisted of 20 
boys and 20 girls. These groups were divided so that 
both Es administered tests to 10 boys and 10 girls 
at each age level with each E administering both 
tests to each S in his group. Those Ss who had 
taken either the WB Form I or the WISC previ- 
ously were dropped from the group. 

Both tests were administered to the S during one 
session with a standard rest period of 15 minutes be- 
tween tests. In the actual testing all the subtests of 
both the WISC and WB were employed with the 
exception of the Mazes subtest on the WISC. Scor- 
ing of each test was done by the E who had ad- 
ministered the test. In the case of questionable re- 
sponses on such subtests as Comprehension, Simi- 
larities, etc., a consultation was held between Es in 
order to arrive at a score that was satisfactory to 
both Es in terms of the criteria as set forth in the 


manuals. 
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Table 1 


Means and Standard Deviations of 
Experimental Groups 


WISC WB 

Scale M SD M SD 
11} Years* 

VS 102.98 13.36 94.90 14.25 

PS 103.63 15.11 108.50 14.74 

FS 103.65 14,25 102.15 14.87 
14} Years* 

VS 108.00 14.21 102.58 15.08 

PS 108.25 9.68 110.23 10.84 

FS 108.55 10.40 106.93 12.79 


*The actual mean ages for these groups were 11 years, 
6} months and 14 years, 7 months, 


Results 


At both the 114- and the 14}-year age lev- 
els, higher mean 1Q’s were obtained on the 
VS and FS of the WISC than on the WB, 
whereas the mean IQ of the PS of the WB 
was higher than that of the WISC at both of 
these age levels, as shown in Table 1. The 
higher means on the VS and FS of the WISC 
and higher mean PS of the WB parallel the 
findings of Graham (2) and Vanderhost eż al, 


a but do not agree with Delattre and Cole 


The initial c 
significance of differenc 


tain essentially the same tanking on the Vs 
PS, and FS on one test as they obtained on 
the other allowing for chance error. 
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In determining whether or not the first conda 
has been met by the data, it is necessary nets 
upon some arbitrary value of r for a Re rie 
terion. In arriving at this arbitrary value fo Fy 
seemed that a relationship between the sea 3 
error of measurement of the WISC and m —_ 
ard error of estimating WISC scores from wa Bice 
would prove to be the most satisfactory. Sinci group 
fect r between the two tests within each Pee A was 
would be neither demanded nor ebuinatlha mag: 
decided that “the desired r would be of aaa e 
nitude that the standard error of eume eee o! 
not greater than 1.5 times the aga follow- 
measurement” (3, p. 14) of the WISC. selationshi! 
ing equation was set up to show this rela 


—— m 
Gwiseo V1 —rw.w = 1.5 Swisc V1— rwiso rettab! 
e w h i he WISC and 
where rw.w is the desired r between the iy £08 


the WB. After solving this equation ae scale 
rw.w the desired z was computed for all Salian 
at both age levels. To satisfy the first a Ta 
desired r should lie between the apm A 
upper 5% confidence limit for this on this first 
3 indicates the results obtained in mee! 

condition. 


. e 
The second condition necessary or i 
lence is that each individual shou 


quiva- 
þtain 


as 
e test 
essentially the same IQ scores on EEE for 
he obtained on the other, also a oq condi- 
chance error. In meeting this a ( was 
tion, a technique devised by Wi 
Table 2 4 
Comparisons Between Experimental an 
Standardization Groups 
WB 
WISC of 
sig. 

a Sig. of “i. 
ie a diff. pervert 
betwen between nen jant? 

Scale means variances meal 

114 Years 138 
vs 1.21 Lit a E 
PS 151 Z EE ; 
FS re 22 At 

14} Years 113 
vs 3.28 1.34 ae 3.10 
PS 4.97** 1.29 ce ies 1.3 
FS 3.98**  3.88** : 

test? 


* Significant beyond the 5% level. 
** Significant beyond the 1% level. 


both oy 
= 40 for Grol, 
Note.—In the Experimental Groups, N = 4 p$ 


Stan ization Fy ver 
at both age levels. In the WISC ardizatio" 44-i 
N = 200 at both age levels; in the WB Stand’ at the on Y° 
N = 60 at the 114-year age level, and 


twi 
ifferences be 
level. In testing the significance of differe: 


ances, df =N —1 


Comparison of the WISC and the Wechsler-Bellevue 


Table 3 


Comparisons Between WISC and WB of the 
Experimental Groups 


Upper 
5% con- 
fidence 
limit 
Ob- forob- De- 
tained tained sired 
Scale p r r Imve Lre Lm 
114 Years 
VS 85 92 95t  .466** 998 .467** 
PS 79 88 .87 .797* 999 .798** 
FS 89 94 94 952 998 .954 
14} Years 
VS 90 95 95 .592** 996 .594** 
PS 41 -64 88} .957 .987 .970 
ES %8 .88 93f 918 958 .958 


* Significant beyond the 5% level. 
* Significant beyond the 1% level. 
Failed to meet the first condition, 


employed wherein two or more alternate 
forms of a test may be tested for equivalence. 
he initial procedure (Lyy-) involves testing 

e means, variances, and covariances simul- 
taneously for equivalence. Provided the null 
YPothesis is rejected at the desired level of 
Confidence, the formulation is then frag- 
mented to determine whether the means, the 
Variances, or the covariances are contributing 
to this lack of equality and if so to what de- 
Stee. In the present investigation the test for 
Variance-covariance (Lec) reduces to simply 
a test between variances since there are only 
two groups present. However, the correla- 
tional term in the covariance has been taken 
pto account in the first condition above. 

ilks has demonstrated that the test for 
means (Ly) is equivalent to an analysis of 
variance design with the tests (WISC and 
c as columns and the individuals as rows. 
keo sequently, the over-all test for equiva- 
ne (Znve) is a powerful and appropriate 
y St to be used in the initial phase of the in- 
esstigation, If there are no significant differ- 
w using this initial test, it is highly un- 

ely that the follow-up tests (Ly, and Lm) 
pee be significant. The values for all three 
ni these tests range from zero (highly sig- 
i cant) to one (no significance). Wilks’ 
ables for small samples (7, pp. 263-264) 
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were used in determining the significance of 
the values given in Table 3. 

Instances where a lack of equivalence exists 
between scales of the WISC and WB in re- 
spect to the first and/or the second condition 
and where the hypothesis is supported are 
shown in Table 3 by the reference symbols 
*, **, and jf. 

Discussion 


The values for the standardization groups 
used in the comparisons between experimen- 
tal and standardization groups were taken 
from the age groupings as given by Wechsler 
(5, 6) and were the closest obtainable to the 
ages of the experimental groups but did not 
coincide exactly with these ages. In the case 
of the WISC, the values were from two of 
the standardization subgroups whose mean 
ages were 103 and 134 years respectively (6, 
pp. 11-13). A difference of a year therefore 
existed between the mean ages of the stand- 
ardization groups and the mean ages of the 
experimental groups whose actual mean ages 
were 11 years, 6$ months and 14 years, 7 
months. In the case of the WB, the values 
used were from subgroups whose mean ages 
were 11 and 14 years (5, pp. 122-123). The 
age difference is a possible but unlikely 
causal factor in reference to the differences 
obtained between experimental and standardi- 
zation groups (Table 2). In addition, Wech- 
sler included in the standardization popula- 
tion Ss from the lower end of the distribution 
of intelligence, whereas this was not done in 
the case of the experimental groups. Hence, 
one would expect to obtain significant dif- 
ferences in a comparison between the two 
groups. On the other hand, greater variance 
occurs about an equal number of times in 
both the experimental and standardization 
groups which is what would be desired in a 
comparison of this nature. : 

Although this limited investigation has 
shown some definite results in terms of the 
specific criteria set forth, it is felt that be- 
fore equivalence or lack of equivalence be- 
tween the WISC and WB Form I within this 
age range can be assumed, further study 
should be done with the subtests of these two 
tests. The present investigation omitted sta- 
tistical comparisons between subtests because 
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of the lack of comparability of the WISC 
subtests with the WB subtests in any way 
other than with the use of a rank-ordering 
type of procedure. Raw scores are assigned 
weighted score values on the WB subtests 
prior to the application of the established 
age norms to the data. On the WISC, how- 
ever, raw subtest scores are assigned weighted 
values and age norms are taken into consid- 
eration simultaneously. Thus on the WB, a 
set of weighted subtest scores for any one in- 
dividual would be the same as the weighted 
scores for another individual of a different 
age who gave the same responses given by 
the first individual. The opposite holds true 
in the case of the WISC. Two individuals of 
different ages giving identical responses on 
all of the subtests would receive different 
weighted scores. Until a method is devised 
that permits statistical comparison of the 
WISC subtests with the WB subtests, it is 
felt that any conclusions drawn concerning 
equivalence of these two tests as a whole will 
be tenuous. 


Summary 


The hypothesis tested in this study stated 
that the WISC and WB Form I are not 
equivalent tests with respect to the VS, PS, 
and FS in the age range of 10 to 15 years. 
In testing this hypothesis, a sample of 40 
white, American Ss at the 11}-year age level 
and 40 at the 144-year age level was used. 
Three criteria for equivalence were specified 
in which (a) a desired y between the VS, PS 
and FS of the two tests was established and 
the differences between (b) means, and (c) 


John R. Price and 


Gareth D. Thorne 


variances of the three scales were tested for 
significance. The hypothesis of lack of ee, 
lence was supported to the degree the wi 
failed to meet these three criteria. At r 
114-year age level, a lack of equivalence ve 
established on the VS on criteria (a) and ( i 
and on the PS on only criterion (b). No a 
of equivalence was found on the FS, At E: 
14ł-year age level, lack of equivalence x 
established on the VS on criterion (b) & 
on the PS and FS on criterion (a). 


Received March 24, 1955. 
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Diagnostic Accuracy or Diagnostic Stereoty py? 


C. H. Patterson 


Veterans Administration Regional Office, St. Paul, Minnesota 


In the April, 1954, issue of this Journal, 
there appeared an article by Albert Kostlan 
entitled “A method for the empirical study 
of psychodiagnosis” (9). This study con- 
cluded that diagnostic inferences which were 

better than chance” were possible using two 
tests and a social case history, and also using 
certain “minimal data” consisting of age, 
Marital status, occupation, education, source 
of referral, and the fact that the subject was 
@ mental hygiene clinic patient (italics mine). 
he original report should be consulted for 
details of the study. 

While this study is ingenious in design, it 
Would appear that there are two criticisms 
which affect the conclusions drawn. 

t l. The measure of chance success was 
taken to be 50 per cent correct in designat- 
Pe statements about a subject as true or 
alse. Since significantly more than 50 per 
oe of two sets of statements were correctly 
joeled by the 20 psychologists participating 
n the experiment when only the “minimal 
data” were available, it is concluded that 
Such data “allow inferences to be made which 
are more accurate than those expected on the 
asis of chance alone. Hence it follows that 
all the batteries allow inferences to be made 
More accurately than on the basis of chance 
Tt because the most errors were made un- 
Se the condition of ‘minimal’ data” (9, pP- 
87). 
i It is suggested here that the proportion cor- 
ectly labeled on the basis of the knowledge 
me the subject was a clinic patient, which 
eye edge was possessed by all judges in 
me J condition, should be used as the chance 
pesctation. It would appear that only if this 
th owledge were not available, and some of 
e subjects were not in fact patients, could 
Per cent be taken as chance expectation. 


Inferences made on the basis of tests and the 
social case history should then be compared 
with the 77 per cent and 68 per cent correctly 
labeled on the basis of the “minimal data” 
to determine whether the results were better 
than chance. These comparisons were actually 
made by Kostlan to evaluate the relative 
values of the tests and case history, but are 
affected by the criticism mentioned below. 

Kostlan states that “there was an expecta- 
tion that clinicians can make inferences which 
are more accurate than chance simply by 
knowing that a person is a psychiatric pa- 
tient” (9, p. 84). It is contended here that 
this is the chance expectation, rather than a 
pure 50 per cent. It is suggested that it is not 
an indication of diagnostic skill that psy- 
chologists, knowing that a subject is a clinic 
patient, can correctly label significantly more 
than 50 per cent of true-false statements 
taken from psychologists’ reports and thera- 
pists’ notes. Such statements tend to be gen- 
eral in nature and frequently psychological 
or psychiatric stereotypes or clinical clichés. 
The greater the number of such statements, 
which can be made about all clinic patients, 
the greater will be the percentage correctly 
labeled. The results would then indicate only 
that psychologists agree that psychiatric pa- 
tients, in general, can be described by certain 
statements or stereotypes. 

2. The conclusions that the use of tests 
and social case history data results in sig- 
nificantly better “diagnosis” than that ob- 
tained from use of only the “minimal data,” 
and (using the therapists’ statements) that 
using the MMPI and either the Rorschach or 
the Stein Sentence Completion, and the social 
case history, results in significantly better 
“diagnosis” than use of all three tests with- 
out the social case history data, are based 
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upon ¢ tests of the differences between these 
various conditions of judging. The F test for 
all conditions taken together was significant. 

The proper procedure for making individual 
comparisons following an analysis of variance 
has been a matter of concern to many statis- 
ticians for some time. Although Guilford (6), 
McNemar (11) and Lindquist (10) approve 
the use of the usual ¢ test for individual com- 
parisons following the finding of a significant 
F, other competent statisticians do not agree 
(1, 2, 3, 4, 5, 7, 13, 14, 18). It would seem 
that it should be clear that the ordinary ¢ test 
is not appropriate where the comparisons are 
not random, but selected, as in the case of 
comparing the largest with the smallest ob- 
tained means; or in the case where all possible 
comparisons are made, in which case a certain 
proportion of the results, determined by the 
significance level selected, will reach signifi- 
cance by chance. 

A number of solutions to this problem have 
been proposed since the first approximate, in- 
tuitive suggestion of Fisher in 1935 (5, p. 57). 
Fisher suggested that the number of possible 
comparisons be taken into consideration, so 
that the required probability for significance 
at the .05 level, for example, would not be 1 
in 20, but 1 in 20 [3k(k—1)] where & is the 
number of variables being compared. This 
Suggestion has been developed by several 
writers, and is mentioned in a few texts (1, p. 
239; 4, pp. 329-330; 7, p. 234), and was re- 
ferred to by the present writer in an earlier 
note (12). The application of this procedure 
in the study under discussion, for example, 
where 10 comparisons are involved, would re- 


method (4, pp. 330-335) 
be expected that this 
will persist in use for some time. In 1951 
Tukey introduced another method (15), and 
later suggested several others, 


for various 
types of conditions (16). 


C. H. Patterson ° . 


a 
Scheffé (13) has also considered this prob: 4 
lem and introduced a method which is ap- 


map" ible. 
plicable where the interest is in all possi : 
comparisons of pairs and combinations. #6 ~ > 


yhere — 
suggests Tukey’s later method for use whe 


the interest is only in the k(k—1) ne 
comparisons. Scheffé’s method is ee 
Jones in his chapter in the 1955 Annua: 
view of Psychology (8). 

Mont recently Duncan (3) has survey 
existing proposals, finding them ine His 
and has introduced his own S 
method appears to avoid the oveicon 
of most of the other solutions. It 8 a i 
tremely simple method to use. Hoga equ 
has been developed only for the case re ex- 
N’s in the subgroups, and needs to 
tended to the case of unequal N’s. 

This is not the place to evaluate t 
and appropriate conditions for th a 
these various methods. The writer Er a 
preparing a paper on this problem. 11 them 
desired to take this opportunity to pee oc- 
to the attention of psychologists hav ns fol- 
casion to analyze individual comparis 
lowing the F test. 5 -a would 

In the study under discussion 5 0 the 
therefore appear that adequate tes a ot 
effects of the different conditions differ- 
made, so that the significance of P the co 
ences, and therefore the validity oh writer” 
clusions, is not known. It is not t articu 
purpose to single out the author for a 
censure, since the same procedure r e 
and is being widely used and sinc is E 
time of the study, adequate techniq al d 
not available, although Fisher’s pepa hope 
Tukey’s 1949 method were. It is to rv J- 
that appropriate solutions will soon ologis!® 
able for all circumstances where ae 
and statisticians have been Le 
awareness of the inapplicability © 
t test. 


al 
e ust 
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A Reply to Patterson 


Albert Kostlan 
VA Hospital, Oakland, California 


C. H. Patterson (5) raises some issues, by 
implication, which are of importance to the 
research-disposed clinician. His first criticism 
is well taken. I differ, however, with the impli- 
cation of the title, that stereotypy connotes 
inaccuracy. What is the diagnostic process if 
it is not the ordering of the patient from a 
supraordinate stereotype (i.e., class of events) 
to more subordinate ones as increments of in- 
formation are accumulated and the most prob- 
able idiographic inferences emerge? Where, 
along this continuum, does stereotypy end? 
The present-day nosological categories, for all 
their disadvantages, are highly useful, em- 
Pirically derived, stereotypes. Patterson sug- 
gests that diagnostic skill was not indicated by 
the condition of “minimal data.” The ques- 
tion remains open, but it is plausible that 
if minimal information would permit valid 
stereotypy, highly accurate inferences could 
be extrapolated from the stereotype. The 
problem has relevance to the current interest 
in statistical versus clinical prediction (2). 
Statistical prediction and its logical extension, 
“cookbook” diagnosis (3), is a special case 
of stereotypy. 
icism is the more 
ssue with the sta- 
sents, but I do feel 


similar to the old Problem of choosing be- 
tween Type I or Type II errors (4, p. 69). In 
the case of form 

diagnostic processes, we do not have enough 
bathwater as it is, without Tunning the risk 


In this context, it may also be appro 
to differentiate between statistical and Pe 
matic significance. In a recent cross-va cp i: 
study of several systems for detecting © Cae 
brain pathology by means of the Rorsc he 
it was found that agreement haiweki 
criterion and one of the systems on z (1); 
fold table yielded a phi coefficient of a dif- 
which was found to be highly significant y ai 
ferent from zero. However, statisticians é 
tell us that such a correlation a, 
Rorschach will do only about ten ee the 
better than tossing a coin. A ane ands 
other hand, is pleased to note that 1 95 pet 
an “organic” record, he can be about i 


; rganic 
cent certain that the patient ag voit o 
lesion! Whither significance? In eatest 


the study Patterson discusses, we E ih 
difference that emerged (with a p of ` jewer 
.01) was approximately six per Cen 

errors in favor of one battery. This is 
of importance when the limited K 
bility of the results is considered. i 
cific studies, notably in clinical psy a 
are examined from these standpoints, 


raises 
statistical objection that Patterson 
comes academic. 
Received July 29, 1955. 
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The Manifest Anxiety and ACE Scales and 
College Achievement’ 


Henry E. Klugh 
Alma College 


and A. W. Bendig 


University of Pittsburgh 


Pho Matarazzo, et al. (2) reported a 
and E correlation of — .25 between MAS 
vi E scores (V = 101), Schulz and Cal- 
vin (3) found an insignificant 7 of .02 (N 
— As additional evidence, we adminis- 

ed the MAS and also Gough’s Hr scale 
ya to all students enrolled in the introduc- 

ith parchology course at the University of 

5 mn during the Fall semester of 1954— 
avail a 184 men and women Ss, data were 
san a on four variables: the ACE, MAS, 
Side r scales and the Ss’ Quality Point Av- 
a (QPA). Raw scores on the three tests 

© converted to stanines on the basis of 
ed norm groups and Pearsonian corre- 
ions between the pairs of variables were 
Omputed. In addition, multiple correlations 
oe the test variables and the QPA cri- 

lon were obtained. 

The intertest correlations were: ACE and 
nia = .11 (not significant); ACE and Hr, 
29 (significant at .01 level); and Hr and 
aie = 29 (significant at the .01 level). 
is Coefficients of each test with the QPA 
Sie were: ACE, .62; Hr, .32 (both sig- 
Cann the .01 level); and MAS, .01. 
3 Mparison of the single order and multiple 
Orrelations indicated that (a) a combina- 


ica extended report of this study may be ob- 
Peyer ithout charge from A. W. Bendig, Dept. of 
“Ychology, University of Pittsburgh, Pittsburgh 13, 
Tnstin; r for a fee from the American Documentation 
institute. Order Document No. 4625 from ADT Aux- 
Libe, ublication Project, Photoduplication Service, 
ting 7) Of Congress, Washington 25, D. C., remit- 
phot ue advance $1.25 for microfilm or $1.25 for 
du Hee eeu Make checks payable to Chief, Photo- 
Pilcation Service, Library of Congress. 


tion of the ACE and Hr scales is a better 
predictor of QPA than the ACE alone (.05 
level), (b) adding the MAS to either the 
ACE or the Hr scales did not significantly in- 
crease the predictability of QPA, and (c) 
adding the MAS to the ACE-Hr combination 
did significantly (.05 level) increase the mul- 
tiple correlation with QPA. 

Our ACE-MAS correlation results fall mid- 
way between those previously reported (2, 
3). A significant negative correlation between 
the Hr and MAS scales has also been found 
in previous samples and casts doubt upon the 
hypothesis that the MAS correlates nega- 
tively with timed tests and zero with un- 
timed tests (2), since the Hr scale is un- 
timed. Apparently when the ACE and Hr 
tests are combined the addition of the MAS 
will increase the validity of the battery by 
acting as a weak suppressor variable for the 
QPA-irrelevant variance in both the ACE 
and Hr predictors. 


Brief Report 
Received June 23, 1955. 
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Editorial Note 


After this issue, the Journal of Consulting Psy- 
chology will publish no more reviews of books. The 
task of reviewing books in all fields of psychology 
will be assumed by a new journal, Contemporary 
Psychology, A Journal of Reviews. Sponsored by 
the American Psychological Association, the new 
periodical will make its first appearance in 1956, 
under the editorship of Edwin G. Boring of Har- 
vard University. 

The Journal of Consulting Psychology will con- 
tinue to review psychological tests, whether they are 
published as paper pamphlets, or as “tests in hard 
covers”—books which are manuals for specific tests. 
The plans of the journal contemplate two stages of 
test reviews. Brief notices, prepared mainly by the 
Editor, will appear promptly as in the past. Se- 
lected tests of above-average importance will later 
be the subjects of more extended and critical re- 
views, prepared by specialists on the invitation of 
the Editor, 

The reviews which appear in the present issue 


Were written by the Advisory Editors, who may be 
identified by their initials. 


Books 


Baldwin, Alfred L. Behavior and development in 
childhood. New York: Dryden Press, 1955. Pp. 
xvii + 619. $6.25, 

In his Preface the author states that he attempts 
make 


“to explicit a theoretical framework which 
can be of help i 


text, it is certainly not 
ter of fact, a theory of 


gins on page 5373 
conceptual devices are 
earlier chapters. The book is divided into two Parts, 
Part One has to do with how the child behaves; 
Part Two is concerned with Prediction of person- 
ality change. The presentation of the material is 
systematic, well-illustrated, and in the style of an 


of the 
elementary textbook. Nevertheless, because 


child 
author’s rather comprenenaive Stent” ee. 
behavior, the book is likely to interest pee E 
student as well as the undergraduate sS p 


ý opinion 
though there may be some Aiseee of ai 
concerning the desirability of describi almost 


work as a theoretical text, it is probable t 
all readers will regard it as a desirable £ 
the textbooks currently available in the 
child development.—J. R. W. 


ddition te 
field 0 


A psychoana- 


Balint, Alice. The early years of life: 1954 


. R C.: 
lytic study. New York: Basic Books, Inc» 
Pp. vii + 149. $3.00. P 

n lyst 
Twenty years ago, the English ah of the 
Balint wrote a book (The Epema ants an 
Nursery) interpreting child behavior lication © 
pee hild 
— of, © 
with children of some of the prina pit have 
behavior and development. The boo than Í 


will today, for many of the pence mi 
new then are well accepted now. atl 
straightforward, informative account po it. r 
opment as the British psychoanalyst s vex,” “T ; 
ter titles such as “The Oedipus ganr serve t 
Castration Complex,” and “Identification > 


ic view 
indicate the consistently psychoanalyti isticate™ 


3 ophi 
from which the book is written. m lai chil- 
parents and many professional wor aan of psy 
dren will find this volume a or ri 
choanalytic fundamentals.—A. M. G. an 


3rd s 
Burt, Sir Cyril. The subnormal mies Na press 
London and New York: Oxford 


stich 
1955. Pp. xx +391. $5.00. ic Britl® 


ii P 

The third edition of the now almost ee o 

volume by Burt has been broadened n clinica! viet 

temporary findings from the fields Jditions renk 

child psychology. These welcome a for the pe 

the original title somewhat misleading ae jst 
covers normality, delinquency, and 


The men are 


as mental deficiency and dullness. aie topics 


frame of reference within peti 
treated makes this volume mite srs oe 
usual, and particularly attrac ive oach, © cept 
have tired of a strictly behavioral anpi the co” pe 
are concerned with the implicam an guidanc® 

of mind for problems of education i 
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spite a good bit of forensic material which is unique 
to the English educational system, the book has 
much to offer to all those interested in problems of 
childhood —A. M. G. 


Bush, Robert R., & Mosteller, Frederick. Stochastic 
models for learning. New York: Wiley, 1955. Pp. 
364. $9.00. 

The authors consider learning to be any system- 
atic process of behavior change which eventually 
reaches a condition of relative stability. This very 
general, descriptive concept of learning is expressed 
in terms of a statistical model which describes but 
does not seek to explain the process of behavior 
change. The model in effect describes a behavioral 
Sequence by expressing the probability of a future 
response in a sequence as a function of the fre- 
quency of certain prior responses. The conceptual 
basis for this general model appears to be simple 
enough, and the authors’ presentation is not dis- 
couragingly complicated. This discussion is particu- 
larly admirable because it provides descriptions 
which involve very few parameters. Since the au- 
thors go directly to their task and do not linger in 
obeisance before the sacred cows of learning theory, 
their approach is, at the very least, refreshing and 
may stimulate investigators to use new designs in 
Procedure and analysis which could result in early 
increments to our understanding of the process of 
behavior change—J. R. W. 


Eissler, Ruth, et al. (Eds.). The psychoanalytic 
study of the child. Vol. IX. New York: Interna- 
tional Universities Press, 1954. Pp. 369. $7.50. 
This volume begins with two contributions from 

the New York Psychoanalytic Society’s 1954 meet- 

ing to consider problems of infantile neurosis, An 
impressive group of child analysts, headed by Anna 

Freud, discusses this complex topic, and their re- 

Corded comments are probably the outstanding fea- 

ture of this book. Of the remaining papers, mention 

should be made of Stevenson’s study of children’s 

treasured possessions, Sperling’s presentation of a 

child’s imaginary companion, and the Planks’ paper 

©n autobiographical accounts of emotional aspects 

Of learning arithmetic. Both jndividual and group 

residential methods for treating disturbed children 

find space in the section on techniques, As con- 

trasted with earlier volumes of the series, the 1954 

book seems to contain more papers on rather spe- 

Cialized topics, and fewer considerations of funda- 

Mental theory of child development. —A. M. G. 


Greenacre, Phyllis. Swift and Carroll: A psycho- 
analytic study of two lives. New York: Interna- 
tional Universities Press, 1955. Pp. 306. $5.00. 
Concerned with the lives and literary careers of 

the creators of Gulliver and Alice, this little book 

pad its origins in the clinical impression of a prac- 
ticing analyst that fetishistic perversions are asso- 
ciated with distortions of the body image. The pres- 
entation of these sensations of change in bodily size 
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or the size of various bodily parts in the books of 
two enigmatic artists_presented a problem in both 
literary criticism and’ psychodynamics. In dealing 
with this challenge, Dr. Greenacre has many sug- 
gestive and stimulating things to say about the de- 
fensive functions of the self image, the psychological 
determinants of satire and nonsense as forms of 
humor, and the relationship between impulse-anxiety 
and literary creativity. Like most such work, Swift 
and Carroll provides new dimensions for the under- 
standing of books of lasting appeal and formulates 
new hypotheses for the comprehension of clinical 
complexities. Whether these hypotheses are sound or 
not is a question which awaits the work of investi- 
gators whose own ingenuity responds to Dr. Green- 
acres’s.—E. J. S. 


Heiser, Karl F. Our backward children. New York: 

Norton, 1955. Pp. 240. $3.75. 

In a book planned to give parents and the inter- 
ested public an over-all view of the problems that 
must be faced in diagnosing, training, and caring for 
the backward child, Heiser has tried to clear some 
of the confusion that parents often obtain from their 
contacts with specialists. He is interested in reliev- 
ing parents’ feelings of tension and anxiety, and giv- 
ing them insight into the needs of the whole child. 
The book is especially recommended to those par- 
ents who are asking: “What about my slow child? 
What can be done for him?” There is an excellent 
index—B. M. L. 


Lorand, Sandor (Ed.). Yearbook of psychoanalysis. 
Vol. 10. New York: International Universities 
Press, 1955. Pp. 277. $7.50. 

This tenth volume continues the tradition of the 
Yearbook of Psychoanalysis in presenting a wide va- 
riety of contemporary psychoanalytic papers. There 
is something here to attract any reader, although it 
is only the rare specialist in psychoanalytic theory 
who will find the majority compelling. Bernfeld’s 
article on Freud’s study of cocaine is illuminating, 
especially considered in conjunction with Jones’s 
recent biographies of Freud. Notes on the Wolf Man 
and on Schreber add to the recorded information on 
these now classic cases. Of the usual series of papers 
on dreams, the one by Lewin seems most note- 
worthy for ingenuity of argument and precision of 
definition. Kant, Mark Twain, and W. S. Gilbert 
are the subjects of interesting psychoanalytic in- 
vestigation. Other papers on ego function, resistance, 
children’s early object-attachments, and various 
symptom manifestations complete the volume.— 
A. M. G. 


Michaels, Joseph J. Disorders of character. Spring- 
field, Ill.: Charles C Thomas, 1955. Pp. x+ 148. 
The author “concludes” that there probably is a 

special kind of psychosomatic disposition that per- 

meates the delinquent individual and gives rise to 
specific individuation at the biological, psychologi- 
cal, and sociological levels. Moreover, he “concludes” 
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that the general pattern of lack of control which 
characterizes persistent enuresis permeates the whole 
psychopathic personality. “Concludes” is a strong 
verb to use in sentences that are so sweepingly gen- 
eral, particularly on the basis of the data presented 
in this book. The volume, with a bibliography of 
235 titles, makes reference not only to the studies 
on persistent delinquency but also to the pertinent 
theoretical literature on personality and character. 
The reported relationship between apprehended de- 
linquency and persistent enuresis is shown, and is 
related to the phenomena of psychopathy. The au- 
thor assumes a typological viewpoint, and argues 
that psychopathic personality and compulsive neuro- 
sis are psychobiological contrasts. The data might 
well lead one to hypothesize the existence of cer- 
tain constitutional factors (among others) in de- 
linquency and other complex behavior. The specific 
nature of these relationships has yet to be shown, 
since there are many variables that must be con- 
trolled. One important uncontrolled variable in most 
of the studies presented here is early interpersonal 
relations—a variable not emphasized by the au- 
thor.—F. McK. 


Super, Donald E. Opportunities in psychology. New 
York: Vocational Guidance Manuals, 1955. Pp. 96. 
$1.15. 


This is one of a series of booklets designed for the 
intelligent choice and planning of a career. It might 
well serve as a model for 
of this kind. Super 


gives the student information of wide scope in a 
highly 


cation in a manner which will probably satisfy, in 


of widely different back- 
difficult undertaking. He 
has drawn upon most of the significant publications 
‘ofession, its Prospects, re- 
and organizations. The index and 
bibliography are brief and designed main 
lume serves a need of long duration 
that may be handed to potenti: 

addition, it is a good contri 
lations of the Profession —F, McK. 


Thorne, Frederick C, Principles of psychological ex- 
amining. Brandon, Vt.: Journal of Clinical Psy- 
chology, 1955, Pp. v + 494, $7.50. 

This textbook is designed as a co i 
x k í mplete guide tı 
psychological diagnosis, based on the authors ‘lenis, 
approach, and essentially operational in nature. Psy- 


chologists. In 
the public rel 
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chodiagnostic testing is relegated to a relative 
minor role; observational and interview sore 
are preferred and examined in unusual and usi af 
detail. Part One covers the theory and process 


» of fac-  * 
psychological examining; Part Two the study of r 


4 : 3 sub- 
tors organizing personality integration. p faa 
topic discussed is exhaustively outlined, but sistence 
synthesis is not achieved. The author’s in 


more 
that mental health and good adjustment are i 


an 
than just the absence of ill-health and aeee aA 
require a positive integrative process, is ri 
and important.—A. R. 


di- 

Wallin, J. E. Wallace. Education of mentally hosa 

capped children, New York: Harper, 1959- 

xiii + 485. $4.50. ions 0A 

Although there is no scarcity of puliga ecial. 
the mentally handicapped, this book is qae ay as 
It is written by one who has been promine ental 
sociated with the field of education of the A 
retarded from its very beginnings, more ae prac- 
years ago. Tracing the origins of many pe some 
tices, Wallin outlines briefly, but adegit aly 
of the major programs for the education entio 
handicapped children, paying particular at sa, teach- 
legislative provisions, administrative practic fale par- 
ing methods, and curricula. This volume specially 
ticular interest for school psychologists, e pro- 
those of relatively recent vintage. Prior tO contrs J 
fessionalization of school psychology, practi gical 
“special education” frequently acquired ‘ol 
training, and many of them became the Perch ologist 
school psychology. The modern school PAT afi Jac 
is well trained in clinical psychology, but © llin’s 
close acquaintance with special education gxtensiv® 
book compensates for much of this lack. fulness ° 
bibliographies add considerably to the use’ 
this volume-—M. K. 


Books Received 


york: 

; w 

De Kok, Winifred. You and your piei En 53.75 a 
Philosophical Library, 1955. Pp. vii ew 


Farrell, B. A. (Ed.) Experimental psycholosY: 4 66. 


York: Philosophical Library, 1955. PP- l 
$2.75. sation 
Sell, DeWitt E. (Ed.) Manual of applied en Men 
psychology. Columbus: Ohio Department y, Pp: 
tal Hygiene and Correction, no date (1 
+ 68 (paper). ott otk! 
Valentine, C. W. Parents and children. a $3.15" 
Philosophical Library, 1955. Pp. xi + 21. 
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